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ABSTRACT 

The report describes the features, unr*erlying 
knowledge base, and goals of the "Smart Needs Assessment Program" 
(SNAP), an interactive, microcomputer-based system designed to 
provide inservice training in special education for regular education 
teachers, 'rhe Teacher Effectiveness Expert System portion uses 
teacher data concerning attitudes, goals, and background to identify 
teaching problems with direct instruction, questioning skills, or 
academic learning time. Finally, the teacher works with the Training 
Experience Selecting Expert System which uses some 200 options to 
produce an individualized set of recommended training experiences 
based on the data entered earlier as well as on responses to 
additional questions eliciting information on student age, teaching 
area, availability of teachers' aides, and other factors. An 
evaluation of the system conducted with 18 teachers suggested that it 
improved attitudes toward mainstreaming and increased concerns about 
impact upon students, collaboration with other professionals and 
widening the benefits of mainstreaming. A study comparing the 
system's training recommendations with those made by expert trainers 
found the SNAP system comparable. Fourteen appendixes comprising 90 
percent of the document provide technical background on the system, 
samples of questionnaires and forms, discussions about the design and 
use of expert systems, and a 50-page bibliographic chart analyzing 
research on effective instruction. (VW) 
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NEEDS ADDRESSED BY THE SNAP PROJECT 



The Special Project to develop and test our microcomputer-based 
needs assessment and training system for teacher training in special 
education was begun in 1983. This system is now called "SNAP" (for 
Smart Needs Assessment Program). Information about the development of 
the system has been Included In our continuation proposals, and a 
complete description of the SNAP System Is presented In the PRODUCTS 
section of this report. 

In this section, we discuss the needs that were addressed In the 
SNAP Project. This section is partially based on the arguments in our 
original application, but also Includes more recent data on training 
needs and Information collected during the course of the project. 
Appendix A contains a technical report which we have disseminated with a 
more detailed explication of the original project rationale. 

The Personnel Training Needs Addressed 

Numbers of Teachers Needing Training 

The placement of special education students in regular classrooms 
continues to put a burden upon regular educators, many of whom lack the 
willingness, confidence and/or training to work with these students. As 
a result, inservice training of regular education teachers has been 
recognized as a critical need in special education. The extent of this 
need is documented by a recent nationwide survey on personnel training 
in special education (McLaughlin, Smith-Davis & Burke, 1986). This 
survey found that inservice training of regular educators was the most 
frequently identified high priority training need (identifed by 862 of 
the states and jurisdictions). 

In the S*ate of Maryland, this training need has been recognized 
for several years and is addressed by a statewide certification 
requirement that all regular educators obtain 3 credits of training in 
special education. In a survey on inservice training needs involving 
2,500 regular educators in the state, our Institute found that over 302 
of the respondents did not have any training in special education (Noel, 
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Halouf i Fitztnartin, 1983). If this percentage can be applied to the 
44.000 statewide population of regular educators, then over 13,000 
teachers in Maryland need Inservlce training to acquire an Initial 
exposure to special education and meet the certification requirement. 
Moreover, when asked If they would like additional training In areas 
related to special education, over 60% of the respondents answered 
"yes". Applying this percentage to the 44,000 pop-jlatlon yields over 
26,000 teachers In Maryland who desire additional training. Not 
surprisingly, in the CSPD component of the State Plan for Special 
Education, the Maryland State Department of Education has Identified 
"training for general education personnel programming for handicapped 
students In regular programs" as one of six training priorities. 

What These Teachers Need to Learn 

Inservlce training for regular educators should address three 
domains: knowledge, skills and attitudes. This section contains a 
discussion of the knowledge and skill domains followed by a discussion 
of the attitude domain. 

Training needs In the knowledge and skill domains . In the 
aforementioned survey of 2,500 teachers In Maryland (Noel et al., 1983), 
we found that teachers rated a broad range of competencies In both 
knowledge and skill domains as Important. In the knowledge domain, 
particularly high Importance ratings were given to knov/ledge of the 
federal and state laws, roles of various educational personnel Involved 
In educating handicapped students, and characteristics of learning 
disabilities. In the skill domain, particularly high ratings were given 
to skills in identifying handicapping conditions vs cultural or 
linguistic differences, conducting individual assessments, communicating 
assessment results, providing for positive social interactions between 
handicapped and nonhandicapped students, using on-going assessment to 
monitor progress, and Identifying school and nonschool resources for 
handicapped students. 

Further evidence of the diversity of knowledge and skill needs 
comes from our experience with the SNAP System project during the last 
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three years. For example, one feature of the SNAP System Is a goal 
setting program (see Appendix B) where the teachers select up to five 
goals for themselves from a list of 23. In our most recent field test 
Involving 25 teachers, we found that all but one of the goals were 
selected. by at least one teacher. The most frequently selected goals 
were: To learn more about (1) how to select and adapt materials (64%), 
(2) how to teach students who are having trouble learning (60%), (3) how 
to provide instruction for slower students without disrupting 
Instruction for other students (60%), (4) how to deal with student 
behavioral or motivational problems (48%), (5) approaches to working 
with special education students (40%), (6) the learning problems 
students can have In school (32%), (7) the behavioral and motivational 
problems that students can have In school (24%), (8) how to analyze 
student learning problems (20%), (9) how to encourage desirable social 
Interactions (20%), (10) how to gain access to Instructional materials 
and equipment (16%), and (11) how to work with other educators on tasks 
related to malnstreaming (16%). These goals represent both knowledge 
and skill domains. 

Another aspect of the SNAP System Is a series of self observations 
completed by teachers In their own classrooms (see Appendix C). Data 
from these self observations are analyzed to Indicate training needs 
related to teacher effectiveness. In our most recent field test, 18 
teachers completed these observations on direct instruction, questioning 
skill, and academic learning time. The group viewed as a whole was not 
seen to have major weaknesses in any of the areas. In only one 
category— students' success in answering questions— was the percent of 
need for training as high as 50%. The following chart displays the 
areas of weakness and the percent of teachers who were Identified by 
SNAP as needing training In these areas. 

Direct Instruction 

amount was too high 6% 
amount was too low 11% 

Questioning Skill 
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opportunities to respond were too few 33% 



success level was too low 50% 

response distribution was uneven 44% 

Academic Learning Time 

engaged time was too low 22% 

success level was too low 22% 

allocated time was too low 0% 



While teaching skills should be Included In the Inservlce training of 
regular educators about malnstreaming, these data suggest that the 
specific skills to be developed should be clearly differentiated. 

Training needs in the attitude domain . It Is generally accepted 
that Inservlce training for regular educators must address attitudes, 
but that attitudes may be difficult to define, evaluate and change 
(Larrlvee & Cook, 1979; Boyle & Sleeter, 1981; Powers, 1983; Burrello & 
Orbaugh, 1982). In our research, we have found ample evidence of the 
need to change teacher attitudes and opinions. In the aforementioned 
survey of 2,500 teachers In Maryland (Noel et al., 1983), the 
respondents were given an opportunity to make comments, and one-third of 
them did. A content analysis of these comments found that the most 
frequent topic area was concerns about mains creaming, and the most 
frequent subtopic within this area was concerns about the burden to the 
teacher, although concerns about the impact on regular students and 
special education students were also expressed. 

The SNAP System Includes a 6-item measure of attitudes or opinions 
related t;o malnstreamlng. In the development and validation of this 
Attitudes Toward Malnstreamlng instrument, we administered the Items to 
53 regular teachers. An average of 31.5? of the responses across the 
six Iterns were In the negative range. For example, 19% of the teachers 
d1sagre(3d with the statement that special education students have the 
ability to participate appropriately In regular classes, 21% agreed that 
the behavior of malnstreamed students too often sets a bad example for 
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regular students, and 66% disagreed that regular educators generally 
possessed the expertise for effectively teaching mainstreamed students. 

Another component of the SNAP System is a version of the Stages of 
Concern Instrument (Hall & Loucks, 1978), which was adapted to measure 
concerns about mainstreaming. We administered this instrument to a 
sample of 98 teachers and found that 21% had information concerns, 4% 
had personal concerns, 7% had management concerns, 23% had consequence 
concerns, 20% had collaboration concerns, and 3% had refocusing 
concerns. 

Summary of The Personnel Training Needs Addressed by the SNAP System; 

1. A large number of regular educators need training in working 
with mainstreamed special education students .. This need exists 
nationally as well as in Maryland and includes teachers who need to 
acquire an initial exposure as well as teachers who have had such an 
exposure and desire additional training. 

2« A broad range of training needs in the domains of knowledge, 
skills and attitudes are present among the population of regular 
educators. An examination of the specific training needs in the 
previous discussion underscores this conclusion. A comprehensive 
approach to Inservice training should be capable of addressing needs in 
all of these areas. 

3. Teachers differ widely with regard to training needs, and no 
single training need is predominant . Among the percentages of specific 
training needs in the preceding discussion, very few exceed 50%. 
Inservice training which provides "blanket" training experiences to all 
of the trainees is likely to miss a lot of individual training needs and 
to provide training in unnecessary areas for the individual trainees. 
True individualization of inservice training requires that specific 
training needs be addressed which occur in a small segment of the 
population. 

The Needs for Improved Approaches 
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The SNAP System was designed to remedy certain flaws In current 
approaches to needs assessment and teacher training. These are 
dtscussed below. 

The Need for Better Needs Assessment Strategies 

At the heart of any Inservlce training program is a process for 
determining what training experiences the trainees will receive. This 
process of needs assessment Is generally a weak link In the process. 

Scrlven and Roth (1978) stated the case quite strongly. 

Needs assessments have been for some time the most ludicrous 
spectacle in evaluation. The usual "models" are farcical and 
decisions based on them are built on soluble sand. (p. 25) 

The need to base training decisions on better data . In current 
practice, if inservlce training experiences are adapted to trainee needs 
at all, they are primarily selected on the basis of trainee self reports 
which are conducted by means of written questionnaires or (less 
frequently) Interviews. Such methods are subject to the following 
criticisms: 

A. Trainees tend to confuse "wants" with "needs," or 
"perceived needs" with "real needs" (Kuh, et al., 1980; 
Mann, 1980). For example, a teacher may want to know the 
procedures for referring a student for placement in 
special education, when the teacher actually needs to 
know teaching strategies for accommodating exceptional 
students in his/her classroom. The need may not be 
expressed simply because the teacher is unaware of it. 

B. Teacher self-reports may be unreliable or inaccurate 
(Hook & Rosenshine, 1979). 

C. Otrier types and sources of information (such as 
environmental factors and teacher performance 
observations) are rarely utilized, although they are 
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often Instrumental In determining the effectiveness of 
Inservlce training. 

The need for linking needs assessment with training . An 
additional weakness In current Inservlce training practices relates to 
the use of needs assessment data In making training decisions. Smith 
and Slantz (1978) referred to this weakness in a summary of Information 
collected from public school personnel: 

In the process of Inservlce training, a strategic point Is 
obviously the selection of the specific program, process, or 
product that Is to be the vehicle for training. For each of 
the countless potential areas In which training may be 
needed, a multiplicity of packages has been developed... 
The problem, as some c* these people see It, is that 
Information has proliferated to the extent that it Is 
becoming unmanageable. ..The selection process that should 
lead to a good match between user and resource becomes 
snarled because of the difficulty in sorting It all out and 
determining which programs will In fact work with specific 
populations. ..(p 247) 

The Need for Better Inservlce Training 

Teachers often complain that Inservlce training experiences are 
irrelevant or ineffective. In recent years, the Importance of inservlce 
training has been Increasingly recognized, and a number of principles 
have been developed for effective Inservlce training. Below are 
described some major principles which are based upon research and 
practice in Inservlce training (Hutson, 1981; Burrello & Orbaugh, 1982; 
Powers, 1983; Joyce and Showers, 1980; Boyle i Sleeter, 1981), as well 
as general literature on adult learning (Banks, 1981). 

1. Teachers should recognize the direct relevance of 

training . Training should be tailored to the individual 
needs of teachers, and to the degree possible, training 
should be self directed and problem oriented. Teachers 



ERIC 



9 



page 8 

should be actively Involved In the process of needs 
assessment and should see how their training experiences 
are derived from analys.tis of their needs. The process of 
needs assessment Itself should be a learning expev^lence. 

2. Training should be both broad based and focuso d. It 
should be responsive to a broad range of needs In 
knowledge, skill and attitude domains while at the same 
time It Is focused on specific content needs., In 
addition. It should be differentiated according to stage 
of learning (from awareness through application) and type 
of learning (refining old skills, learning new skills, 
learning new knowledge, changing attitudes, etc.). 

3* Training should draw upon the full ranc^e of resources and 
methods available . In addition to commercially available 
products, a number of Innovative and effective resources 
and methods continue to be developed, including teacher 
facilitators, simulations, etc. A system for inservice 
training should readily Incorporate new training 
resources and methods. 
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PRODUCTS AND ACTIVITIES 

The SNAP System uses four measurement Instruments, a knowledge base 
of training options, and two expert systems as displayed in Figure 1. 
In the. following section, we discuss these products and the development 
and evaluation activities related to them. 

Measurement Instruments 

Descriptive Survey and Attitudes Toward Mainstreaming Scale (see 
Appendix D): This computer program is linked with the Stages of Concern 
Survejf and both are usually completed in one session at the computer. 
The information collected by the Descriptive Survey serves two 
functions. Primarily, it is used to determine decision factors such as 
teaching level and teaching area. Also, it was used in our evaluation 
activities to obtain data on trainees. 

The Attitudes Toward Mainstreaming Scale is a six-item scale 
designed to provide a measure of the teacher's attitude toward 
handlceipped students and mainstreaming. The items were selected from a 
larger set of items on the basis of a field test with S3 regular 
education teachers. Appendix D describes the development of this scale. 

2. Stages of Concern (SOC) Survey (see Appendix E): This is a 
computer program that delivers and interprets our revision of the Stages 
of Concern questionnaire developed by Gene Hall and his colleagues. Our 
revision was designed facilitate its use in the SNAP System. The 
process of adapting, testing and final revision is described in our 
Technical Report #201 (Appendix F). 

Because of concerns about the scoring and interpretation of the SOC 
instrument, we developed an algorithm for identifying subscales which 
could be considered as high or low enough to have training implications. 
Briefly, this algorithm calculates the overall mean and standard 
deviation of the 30 items on the revised SoC instrument, and the mean 
and standard error of each of the 6 subscales (5 items each). It then 
identifies "outliers" — scales for which the mean is more than one 
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standard error away from the overall mean plus or minus the overall 
standard deviation. The development of this algorltN is described in 
our TechnlCAl Report #203 (see Appendix G). The algorithm performs its 
calculations immediately after the teacher completes the survey, a.nd it 
presents the results to the teacher if? a graphic profile. The outliers 
are then stored on the coiTrputer disk for later use in selecting training 
experiences. This approach to analyzing the SOC has two major 
advantages— it produces data that can readily be used by the computer, 
and it provide*- a more accurate analysis of the SOC profile than can be 
accomplished by visual inspection. 

3. Goal Setting Program (see Appendix B): This computer program 
presents the teacher with 23 possible learning goals and allows him/her 
to select up to 5. The teacher can change the selection at any time. 
The program is design^id to allow easy modification of the list of 
available goals. An initial test of this survey is described in 
Appendix H. In our final field test, 25 teachers completed this Goal 
Setting Program, and all but one of the 23 available goals were selected 
at least once. The selected goals are Included in the set of trfdning 
needs covered by the SNAP Systern. Our inclusion of this program 
reflects our belief that 1n> rvice teacher training should be driven, at 
least in part, by Che learning goals of the teachers themselves. 

Classroom Observations (see Appendix C): These observations are 
conducted by the teacher in his/her own classroom, the., the data are 
entered into the computer by means of a computer program which queries 
the teacher for specific items of information. These observations focus 
on the teacher's use of instructional time and the teacher's questioning 
methods and the amount of success experienced by the students. These 
specific areas were selected after our extensive review and analysis of 
research on teacher effectiveness; we consider them to be critical areas 
for assessment and training. 

Summary of the Technical Operation of the SNAP System 

Before proceding to the description of the training approaches used 
in the SNAP System, a summary of the technical operation of the needs 
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assessment process might be helpful. The trainee begin? his/her 
experience with the SNAP System by completing the Descriptive Survey and 
the Attitudes Toward Mainstreaming Scale, the Stages of Concern Survey 
and the Goal Setting Program. This is frequently but not always done in 
one session at the computer. The trainee has a computer diskette which 
stores the result^^ of his/her interactions with the computer. 

Following this, the trainee completes his/her self observations, 
which may take approximately three weeks. The trainee interacts with 
the computer to enter the data from each observation. This is the 
Teacher Effectiveness Expert System. ThU system interprets the self 
observation data according to the rules in the knowledge base, and 
determines if the teacher has problems related to the three areas of 
teacher effectiveness previously described. The results of this 
interaction are stored on the trainee's diskette. 

The final interaction with the computer involves the Training 
Experience Selecting Expert System. This system starts with the data on 
the student's diskette and selects various combinations of training 
experiences which meet all of the training needs presented. It then 
asks questions to narrow down these alternatives. For example, it may 
ask if the person has a teacher's aide, and if the person does not, 
eliminate any training alternatives which require an aide. It may ask 
about prerequisite knowledge. It may ask for more specific information 
about problems that the teacher wishes to learn about. All of these 
questions are generated by the codes associated with the sets of 
training options the system is considering. Thus, whenever we code and 
add a new training option to the data base, the system automatically 
begins to ask the questions needed to select or eliminate that option. 
It also tries to make its selections with the fewest possible questions. 
The final product of all of this is an inCividualized set of recommended 
training experiences for the trainee. These experiences meet as many 
needs as possible while being consistent with such decision factors as 
student age, teaching area, etc. These recommended training experiences 
form the basis of the SNAP System inservice training. 
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Knowledge Base of Training Options 

Approximately 200 training options comprise the current training 
options database (Appendix I). Each training option is coded according 
the the factors considered by the SNAP System in selecting training 
experiences. The database is easily altered to add, delete, or replace 
training options. Activities from which teachers can Improve their 
abilities to teach in mainstreamed classes are vast in number and 
variety. Prior to the teaching of new SNAP courses, the database will 
be adapted to the needs of the participating school districts. Types of 
training in tne SNAP database will remain extremely diverse. 

SNAP training options appear in a great variety of formats. 
Including (1) print media (e.g., books, articles, course handouts, 
chapters from books, modules, pamphlets), (2) non-print media (e.g., 
films, videotapes), and (3) activily-based experiences (e.g., meetings 
with other educators, collaboration with other teachers in school, 
videotaping for self-observation, case study, tutoring a handicapped 
child, meetings with handicapped adults). 

Categories of Training Experiences 

In the following section, we discuss and give examples of training 
options in our current data base as related to the domains of training. 
Stages of Concern, and self-selected goals. As indicated in Figure 1, 
the SNAP System reviews the affective needs. Stage of Concern, 
self-selected goals, questioning problems, academic learning time 
problems, direct instruction problems and other decision factors and 
selects training options from the data base which meet the needs in the 
most efficient way. 

Training Options for Specific Domains ; 

Knowledge: Informational training options 
address many areas related to 
mainstreaming, such as federal and 
state law, lEP's, characteristics of 
specific handicaps, special education 
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procedures within school or school 
system. These options are most frequently 
written materials obtained from books and 
journals, although other formats are 
Included. 

Skill: Numerous training options teach strategies 
that teachers can use In malnstreamed 
classes. Procedures are both 
generic (e.g.. Grouping and Special 
Needs Students) and specific to a grade 
level or subject area. Many skill level 
training options teach strategies 
that give rationales and step-by-step 
procedures so that teachers can prepare 
their own lessens for Implementation. 
Some of the teaching strategies are 
methods by which teachers can assist 
all the class, special education and 
regular students alike. In becoming more 
competent learners. An example Is 
Author's Chair/Peer Conferencing, which 
Is a language arts strategy. Other 
teaching strategies are Intended to help 
the classroom teacher provide appropriate 
instruction to special needs students. 
An example Is Tape Recording Educational 
Materials for Secondary Handicapped 
Students. Some training materials are 
intended to help teachers manage their 
classrooms more successfully, such as 
the texts on managing the elementary/ 
secondasy classrooms effectively. Some 
training Is designed to assist the teacher 
in managing malnstreaming, such as "Don't 
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Drown In the Mainstream" published by Kids 
Come In Special Flavors. 

Attltlde: Some of the training options are Intended 
to Improve teachers' attitudes toward 
malnstreaming and special needs students. 
The attitude training options Include 
films, such as "David" and "A Different 
Approach". Videotapes Include "Like Other 
People" about the feelings of people with 
cerebral palsy and "Kevin", a narrative 
about blindness spoken by a blind child. 
Some training activities bring teachers 
together with one another so. that those 
with positive attitudes may Influence those 
with less than positive attitudes. Some 
activities bring teachers Into contact with 
children or adults with handicaps. 

Training Options for Specific High Level Stages of Concern 
Regarding Malnstreaming: 

Consequences: Teachers at this stage of concern 

care about the successful Integration 
of special education students In 
their regular classes. Training 
options which pertain to this concern 
Include materials on peer tutoring and 
within class grouping. Materials on 
cooperative learning techniques also 
relate to this concern. 

Collaboration: Teachers at this stage of concern care 
about effective collaboration with 
their colleagues. Training options 
appropriate to this concern Include 
recormnendatlons with guidelines for 
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meetings with special educators and 
for peer observation. 

Refocusing: Teachers at this stage of concern are 
Interested In adapting Innovations and 
may be Interested In reaching beyond 
their own school for other ways of 
making malnstreaming work* To meet this 
stage of concern numerous organizations 
and resources are Included In the 
training options database* These 
Include the Council for Exceptional 
Children, the Spina Bifida Association 
of America, the American .Foundation 
for the Blind, and curriculum 
development personnel at the University 
of Maryland who can assist teachers 
In developing new curricula* 

Training Options for Specific Self-Selected Goals ; 

All 23 Learning Goals In SNAP have multiple training 
options associated with them. Below are examples that 
Illustrate sample goals with appropriate training 
activities: 

Goal: I would like to learn more about how to 

select and adapt materials to teach students 
who have trouble learning. 

Activity: Read article which tells about tape record- 
ing educational materials for secondary 
handicapped students 

Goal: I would like to learn more about the 

learning problems that students can have 
In school 
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Activity: Study handout which (1) lists types of 
difficulties learning disabled students 
often have in school, (2) tells situations 
in which the difficulties are likely to 
occur, and (3) suggests adjustments teachers 
can make. 

Practical and theoretical concerns . It is generally known that 
teachers benefit from information which is based on research and theory 
but is translated into a format that is ready for practical application 
(Waxman, 1985). SNAP training options are generally at the practical 
l»»vel, so that they will be found useful by teachers. However, a small 
number of training options are more research- or theory-based to appeal 
to certain teachers to whom these perspectives are of interest. 

Grade level and subject matter relevance . Many training options 
are appropriate for all teachers regardless of the grade or subject they 
teach. However, many training options are appropriate only for specific 
grade levels (e.g., Life-Size Learning Games for primary teachers) or 
for specific subjects (e.g.. Science and Life for science teachers). 
Training recommendations work in such a way that teachers receive 
training which is appropriate both to their generic and their specific 
needs. For example, a teacher requesting assistance in conferring with 
parents will be assigned a training option about meeting with parents, a 
generic training option appropriate to a specific goal. If the teacher 
also wants training that is useful for teaching high school science, the 
teacher will be assigned a training option called Science and Life that 
is only appropriate for high school science. 

Training Formats 

The SNAP System is intended for use in a variety of contexts. 
Including workshops, inservices, and school-based teacher assistance 
teams. In all cases, the training content is highly individualized. 
When the system Is part of group training, the inservice trainers are 
challenged to integrate the training recommendations for individuals 
into meaningful training for the group as a whole. As a final field 
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test of the SNAP System, an Inservlce course was delivered to a group of 
18 teachers In a school system. This field test Is described In the 
section on EVALUATION. 

The Two Expert Systems 

The SNAP System uses two expert systems to answer the questions: 
(1) What training does the teacher need? (2) What training options are 
available to meet these training needs? The first question Is answered 
through the diagnostic components of the System (see Measurement 
Instruments above). Including the Teacher Effectiveness Expert System. 
The second question Is answered through the prescriptive component of 
the system, which Is the Training Experience Selecting Expert System. 

These two systems are technically very different from one another. 
They differ In the form and substance of their knowledge bases and In 
their Inference mechanisms. Their technical differences and the 
rationale for using the two types of expert systems are explained In 
Appendix J. This section discusses each of these expert systems at a 
practical level. 

The Teacher Effectiveness Expert System 

One of the measurement approaches for Identifying a teacher's 
training needs Is classroom self observation. As previously discussed, 
the teacher collects self observation data over a three week period and 
then Inputs the data when queried by the computer. For this data to be 
used by the SNAP System, It must be Interpreted. The Teacher 
Effectiveness Expert System Interprets this data by comparing It to setj 
of rules about effective teaching. This expert system evaluates a 
teacher's effectiveness In the areas of assuring an adequate amount of 
academic learning time (ALT), providing the appropriate amount of direct 
Instruction (DIR), and providing all students with adequate 
opportunities to respond to questions successfully (QUES). 

Rules In the Teacher Effectiveness Expert System (Appendix K) were 
developed through a complex process. Initially, the broad area of 
effective teaching was broken down Into six categories— Instructional 
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approaches, time factors, teacher planning, affective factors, teachers' 
knowledge and training, and diagnostic-prescriptive teaching. Next, 
literature In these areas was reviewed and variables relevant to rules 
production were charted (Appendix L). From these charts, the basic set 
of rules was written. Next, the basic set was expanded, as described 
below, to cover all relevant classroom variables. The rules are In 
three categories— Academic Learning Time (ALT), Direct Instruction 
(DIR), and Questioning Skill (QUES)— to correspond with the three major 
areas of effective teaching as delineated in the SNAP project. 

Figure 2 is an example of an Academic Learning Time rule drawn 
directly from research, (Rosenshlne found high Academic Learning Time 
in average second grade reading, language arts, and mathematics classes 
which had high student engagement rates.) As illustrated in this 
figure, rules in this expert system include numerous classroom 
variables. 

Figure 2 

If grade = 2 

and teaching area = reading 

or teaching area = language arts 

or teaching area = mathematics 

and students' achievement level = average 

and students' engagement time = high 

then 

Academic Learning Time = HIGH <1.0> 

Reference: Rosenshlne, 1980 

Through our analysis of the research on effective teaching we 
observed that some classroom variables have been studied more 
comprehensively than others. When we discovered classroom variables not 
covered by research, we derived rules through extrapolation, i.e., we 
Inferred rules from rules already drawn directly from research. For 
example, we found research findings regarding second and fifth graders 
of average achievement that were sufficient for Academic Learning Time 
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rules production, but we had to Infer rules to cover third and fourth 
graders of high and low achievement levels. 

Our expert system uses "certdlnty factors" to Indicate the level of 
confidence we have In our rules. If a rule was drawn directly from 
research, as in the case of the rule In rigure 2, then a certainty 
factor of <1.0> was used. If, on the other hand, a rule required that 
inferences be drawn from other rules, the certainty factor was dropped 
to reflect the amount of Inference. A certainty factor of <0.9> 
Indicates that an Inference was drawn regarding one variable In the 
rule. A certainty factor of <0.8> Indicates that inferences were drawn 
regarding two variables In the rule, and so on. 

Teachers Interacting with the expert system first Input their 
classroom self observation data then provide responses that are 
necessary for the system to evaluate their data. When the system has 
learned enough about a teacher's style, it Invokes sufficient rales to 
cover all the variables. The teacher then is given an evaluation, such 
as "Academic Learning Time is medium <0.8>." To enhance this brief 
feedback the system also delivers a message, such as: "Although your 
students appear to be engaged in learning tasks at a high rate, the 
amount of time available for Instruction seems to be somewhat shorter 
than It should be. Perhaps you could arrange the schedule for your 
students so that they have more time in class for learning." 
Additionally, the teacher can request the system to display the rule or 
rules that were Invoked. Teachers, therefore, who use the Teacher 
Effectiveness Expert System, may observe the process by which decisions 
about their self observations are made. 

In addition to providing teachers with immediate feedback, the 
system assesses teachers' data to determine the presence of certain 
training needs. Identified needs in the areas of Academic Learning 
Time, Direct Instruction, and Questioning Skill are added to the 
teacher's needs assessment profile. The second expert system, the 
Training Experience Selecting Expert System, recommends specific 
training activities for each area of identified need. 
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Training Experience Selecting Expert System 

The second expert system in the SNAP System Is known as the 
Training Experience Selecting Expert System. Unlike the rule-based 
system previously discussed, t^^is system consists of frames rather than 
rules. Each frame is a description of a training option. The expert 
system contains approximately 200 training options at present. In this 
frame-based approach, a "hypothesize and test" mechanism operates to 
find the smallest set of training experiences that addresses the largest 
set of training needs. Simply put, this expert system considers the 
training needs of the teacher and all available training options, then 
it recommends specific training activities which cover all of the needs. 
This approach is discussed in detail in Appendix J. 

Figure 3 is an example of a frame in the Training Experience 
Selecting Expert System. A frame consists of codes which make the 
training option specific to certain training needs. Other information 
about the training option which would be of interest to teachers, such 
as a training option summary, is not included in the frame but may 
become conveniently available to teachers. Frames are never visible to 
teachers using t*ie SNAP System. 

Figure 3 

Frame Describing Training Option 93 

Tropt 93: Tape Recording Educational Materials for Secondary 
Handicapped Students 
SOC = management, 

GOAL = improving classroom adaptability OR 

using media to educational advantage 

in the classroom, 
ALTprob = engaged time OR 

success level, 
TLEV = junior high OR 

senior high 
SHAPE = article . 
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TROPT = training option 

SOC = stage of concern about malnstreaming (management Indicates 

concerns related to classroom management) 
GOAL = the teacher's professional development goal 
TLEV = teaching level 
SHAPE = the format of the training option 

The process of preparing frames to add to this expert system was 
really a process of collecting training options and coding theffl In the 
training options knowledge base. The collecting process Is described 
below. Codling of training options Is explained In the Training Options 
Coding Manual (Appendix M). Training options themselves are In Appendix 
I. 

The Collecting of Training Options . Interviews with special 
educators and media specialists guided the Initial search for useful 
training options. Training options were then collected in the : road 
categories of attitude, knowledge, and skill. Though the acquisition of 
training options moved generally from the attitude and knowledge domains 
to the skill domain, the collecting process focused on finding training 
options that were appropriate to specific training needs. Once the set 
of training options appeared to be sound in each of the broad 
categories, a check was made to see that all training needs could be 
adequately covered by one or more training options. Making final 
additions and code revisions completed the set of training options. 

Acquisition of training options in the attitude and knowledge 
categories were found in a variety of sources. The Educational 
Technology Center at the University of Maryland College of Education has 
a large collection videotapes on numerous topics. All Educational 
Technology Center materials which might relate to special education were 
reviewed, and all those which would be useful as training options were 
described in the training options knowledge base. Similarly, materials, 
both print and non-print, at the University of Maryland vocational 
education curriculum laboratory were reviewed, and those useful to SNAP 
were described in the knowledge base. Descriptions of materials from 
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these two sources Included Inforinatlon to help SNAP users locate and 
acquire them. Materials from these two sources were not stored with 
other training options. Users must make special arrangements to borrow 
them. 

Other training options In the categories of attitude and knowledge 
were acquired directly from publishing companies, clearinghouses, 
foundations, and special educators. Books and pamphlets were generally 
collected through these sources. Several of the special educators who 
assisted In the training options collection process were themselves 
Inservlce trainers. These individuals not only contributed printed 
materials; they also provided descriptions of procedures they use In 
special education Inservlce (e.g., pairing a teacher with a poor 
attitude with a colleague who has a positive attitude). Descriptions of 
many of their activities accompanied be necessary materials, then, 
became training options. 

Skin level training options were mostly found in professional 
journals and textbooks. Numerous activities were found, for example, in 
Teaching Exceptional Children . While most skill level training options 
are teaching strategies appropriate for specific content areas, other 
skin level training options concern teaching classes with malnstreamed 
special education students. Still other skill level training options 
concern effective classroom management. Several training options to 
help teachers Improve their teaching skills were developed specifically 
for the SNAP training options collection. These Included 
self-observations, peer conferencing, meetings with special educators, 
and visits to other teachers' classrooms. 

The Recorranendinc) of Training Experiences . Teachers using the SNAP 
System receive their training recommendations as the culmination of 
their Interactions with the system. Figure 4 Is an example of SNAP 
System training recommendations as they are presented to the teacher. 

Figure 4 

Training Recommendations 
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Analysis is now complete. The following training options 
are applicable: 

Self-Correction for Improving Writing Skills R169 * 
Spelling R126 

Word Processing to Improve Student Writing RX73 
Improving Comprehension R170 
Vocabulary Centers R184 
Dialogue Journals R128 
Author's Chair/Peer Conferencing R127 
& ** 

Mathematics and the Special Student R125 
Language Experience for Problem Solving In 

Mathematics R132 
Direct Instruction of Mathematics R144 
& 

Strategies for Teaching Students Who Have 

Trouble Learning R114 
Modifying Classroom Exams for Secondary LD Students 

R116 
& 

Conference with Special Education Teacher R76 
* R = Recoj'd number 

** & = Ampersand delineates groups of training options; 

Implication Is for teacher to choose one from each 
group, unless otherwise Instructed by Inservlce 
trainer. 

The two expert systems In the SNAP System work together to assess 
teachers' training needs and to prescribe Individualized training 
activities. This discussion summarizes activities that were conducted 
during the development of the system and Identifies many of the 
activities of teachers using the system. 
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EVALUATION 



This section describes the two major evaluation activities 
conducted on the SNAP System. Evaluation and validation Information 
used In developing the measurement Instruments are Included In the 
technical reports found In Appendices F, G, J, N. 

SNAP Field Test 

A final field test of the SNAP System, an inservlce course was 
delivered to a group of 18 teachers In a school system. They taught 
grades K-12 and were highly diverse In ternis of their backgrounds. 
Interests, and current teaching situations. Because the final field 
test was In the context of group training, ii.was essential that course 
planning focus on the following consideration: Individualized 
Instruction should not Isolate Individuals from one another. The 
dynamics of the social contexts should be used to enhance teachers' 
professional development In the domains of attitude, knowledge, and 
skill. 

Teachers In the final field test SNAP course worked on 8 to 30 
training options recommended by the computer. Some teachers pursued all 
of their training options In great depth, while others skimmed some 
materials and spent more time with others. Some teachers worked on some 
activities that others were also working on, providing a ready 
opportunity for shared learning experiences. Generally, though, the 
teachers worked Independently on their Individual activities. 

Each teacher was required to write reviews on the recommended 
training options. Each review included a discussion of the 
appropriateness of the training option for the teacher and gave a plan 
for how the teacher could apply the training in his or her mainstreamed 
classroom. These reviews served two functions. First, they provided a 
source of data for our evaluation of the SNAP System. Second, they 
provided a structure for the teachers' work on the training options. 

The set of SNAP training materials was mostly available to teachers 
on the site. Some materials were not available on the site but were 



ERIC 



page 26 

easy for the trainees to locate and acquire. Some training options 
Involved activities In the trainees' classrooms or schools. Others 
involved venturing out Into the community. 

The major thrust of the course was the Individualized work 
completed by each teacher with the support of the course Instructor. 
However, ro make use of social contexts, as previously discussed, we 
also explored certain large group and small group activities. For 
example, discussions were held on malnstreaming as a concept and as a 
fact of teachers' professional lives. Issues such as the Impact of 
special education labels were also discussed In large groups and in 
small heterogeneous groups. These group activities seemed to bring 
teachers into closer working relationships with one another, while the 
content of their work provided a substantive framework for their 
Individualized tasks. Additionally, social contexts brought together 
Individuals with varying attitudes, allowing those with positive 
attitudes to influence those with less than positive attitudes, an 
important component in malnstreaming education (Larrivee and Cook, 
1979). 

In the final weeks of the field test training, teachers gave 
presentations of one of their assigned training options. With the 
concept of teachers' individual training needs in mind, some 
presentations were to the whole class, but others were to special 
interest groups, for example just elementary teachers or just secondary 
school teachers. Individual presentations were intended to promote 
knowledge acquisition, skill development, and/or positive attitude 
enhancement. All presentations were accompanied by group discussion. 

Participants in the final field test of the SNAP System acquired 
several competencies; these Include: 

1. Teachers who began the course at information or 
personal stages of concern regarding malnstreaming 
advanced to higher level stages of concern such as 
consequences or collaboration, as measured by the 
Stages of Concern Regarding Malnstreaming. 
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2, Teachers acquired increased competence on goals they 
selected for themselves. A full listing of goals is 
Included In Appendix B. 

3, Teachers who were found to be In need of training to 
IrTiprove their teaching effectiveness in the areas 

of (1) questioning, (2) academic learning time, or 
(3) direct Instruction acquired Increased competence 
In the area(s} of need. 

4, Teachers found to need Improved attitudes 
related to rnalnstreaming developed more positive 
attitudes, as measured by the Attitudes Toward 
Malnstreaming scale. 

SNAP teachers' attainment of f^-se competencies was measured in two 
ways: (1) Teachers' attainments were measured in terms of Individual 
course objectives, which were established through SNAP needs assessment, 
and self-evaluated In conference with the Instructor; (2) The transfer 
of knowledge, skill, and attitudes Is evaluated through follow-up 
evaluation with the teachers In the semester following the SNAP course. 

The Role of the SNAP Instructor . The role of the Instructor was 
to facilitate the effective use of the training options. Moreover, It 
was the Instructor's job to see that an Individualized training approach 
became a rich classroom experience with effects reaching into teachers' 
own classrooms. The group meeting approach allowed new knowledge and 
skills to be reinforced and extended . jng peers. Also, the enlightened 
or positive attitudes of som group members Influenced the positive 
attitude formation of others. The Instructor used classroom dynamics to 
enhance the professional development of teachers enrolled in SNAP. The 
Instructor also assisted teachers in experiencing a deeper commitment to 
teaching malnstreamed students. 

Stages of Concern (SOC) and Attitudes Toward Ma l nstreaming Scale 
(ATMS) . We administered the Stages of Concern and Attitude tests prior 
to training and during the last session of training- Means and standard 
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deviations are displayed in Table 1, The Improvement In ATMS scores was 
tested be means of a ftest for dependent samples and found to be 
statistically significant (t=4.51,17, p < ,001). 

Table 1 
Mean Scores on ATMS 
(range 1 to 5) 

Prior to After 
Training Training 

mean 3,5 4.0 

SD ,4 ,3 

The Stages of Concern showed an obvious Improvement as displayed In 
Figure 5, This figure includes graphs of the Stages of Concerns 
profiles for our final field test trainees before and after training, as 
well as the profile for our overall standardization sample. The 
profiles are expressed in percent of the trainees with outliers (as 
determined by the algorithm developed in our project). 21% of the 
standardization sample had Information concerns, 39% of our trainees had 
information concerns prior to training, bt^c none had information 
concerns after training. Management CG*icerns among our trainees wera 
strongly decreased after training, with the number of negative outliers 
(indicating low levels of concern about management) Increasing from 44% 
before training to 78% after training. In contrast, consequence and 
collaboration concerns Increased, with the percent of positive outliers 
Increasing from 17% and 28% (respectively) before training to 33% and 
72% after training. 

These results suggest that our training was able to Improve 
attitudes toward malnstreaming and decrease the lower level concerns 
while Increasing the teachers' concerns about the impact upon students, 
collaboration with other professionals, and widening the benefits of 
malnstreaming. This sort of movement toward higher levels of concern is 
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FIGURE 5 
STAGES OF CONCERN DATA 



STAGES OF CONCERN: 

1 = in-format ion 

2 = personal 

3 = management 

4 = consequences 

5 = col 1 aborat i on 

6 = i erociiSing 
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purported to be associated with teacher development In the Stages of 
Concern modeU 

Course evaluation . Teachers in our final field test sample 
completed an evaluation of the SNAP System course. This evaluation was 
designed to determine the success with which the ss had met the 
Individual training needs of the teachers. The results are displayed 
below. These ratings are on a 1 to 5 scale, with 5 being positive. 

How helpful for learning about: 

1. Ideas that can be used in classroom 4.5 

2. Teaching students who have trouble learning 4.5 

3. Effective teaching 4.5 

4. Specific handicapping conditions 4.2 

How helpful in developing: 

5. Positive attitudes toward students 4.4 

6. Positive attitudes toward mainstreaming 4.4 

How appropriate for: 

7e Grade level 4.3 

8. Subject area 4.4 

9. Self-selected learning goals 4.0 

Other items: 

10. Overall attitude toward training options 4.0 

11. How well did training options build 4.0 
confidence about teaching special needs 
students? 

12. Compared with other introductory courses, 4.1 
how well did the training options address 
specific needs? 

13. Compared with other special education 4.4 
courses, how well did the training options 
address specific needs? 
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The evaluation also Included open ended questions. Teacher 
responses were subjected to a content analysis. The results are 
presented In Appendix 0. All of «je teachers considered the course to 
be a successful learning experience,, and 83% attributed this to the 
quality, variety and usefulness of the training options. A number of 
Improvements were suggested, and several teachers expressed confusion 
concerning the function of the computer and the self-observations. We 
feel that this was partly due to the developmental nature of the system, 
and would be correctable In future administrations of the training. 

Expert Validation Study 

We conducted a study which compared the training recommendations 
made by the SNAP System with similar recommendations made by expert 
trainers. This comparative study was patterned after similar validation 
studies of expert systems In fields such as medicine. This study was 
completed In two phases. In Phase One, three expert teacher trainers 
duplicated the function of the SNAP System In selecting training options 
for individual teachers on the basis of their needs assessment data. In 
Phase Two, the recommendations of these three expert trainers were 
Intermixed with the recommendations made by the SNAP System and 
evaluated by a second group of three expert trainers. These two phases 
are described below. 

Phase One 

Three expert teacher trainers were identified through a process of 
peer nomination. Each was Independently Identified by two different 
nominators as having excellent qualifications In this area of inservlce 
training. All three of these people had Ph.D. degrees in special 
education and several years of experience in teacher training, including 
the inservice training of regular educators about mainstreaming. 

These expert trainers were given the needs assessment information 
on six of the teachers in our final field test sample and were 
instructed to make individualized training recommendations by selecting 
training experiences from the data base of training options. To control 
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for the effects of varying numbers of training recommenaations, the 
expert trainers were given a target number of training options to 
produce for each trainee. These target numbers were the numbers of 
training options recommended as highly appropriate by the SNAP System, 
and varied from 7 to 12, The expert trainers were Instructed to contact 
the experimenters If this target number could not be met, but none 
elected to do so and all target numbers were met. 

The following relevant observations can be made from the results of 
this first phase: 

Agreement Between Recommendations , A question can be asked 
concerning the degree to which the expert trainers agreed between 
themselves In the recommendations made for each trainee, and the 
differences between the SNAP System and the expert trainers In this 
regard. When the recommendations made by the three expert trainers were 
paired, the percent of agreements was found to be relatively low, 
averaging 7,92 agreements. When the recommendations made by the expert 
trainers were paired with the recommendations made by the SNAP System, 
the percent of agreements was lower, averaging 5,3%, A distribution Is 
displayed In Table 2, 



Table 2 

Agreements In Training Recommendations Between 
Pairs of Expert Trainers and 
Expert Trainers Paired with the SNAP System 



Pairings: Expert/Expert 



Expert/SNAP 



Q% agreements 
Between 0% and 10% 



8 



6 



9 



6 



Between 10% and 20% 
Between 20% and 30% 



2 



2 



3 



0 



Total 



18 



18 
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These findings suggest that the expert trainers' selection of 
training experiences was Influenced by a number of factors beyond the 
needs assessment data provided. Informal Interviews conducted with the 
three expert trainers suggested that they tended to draw upon their 
experiences In using different training techniques, their preferences 
for specific materials, ano certain fundamental assumptions and beliefs 
about the training needs of regular educators working with handicapped 
students. 

Use of available training options . Across the six test cases, the 
SNAP System reconmiended a total of 41 different training options, while 
the expert trainers recommended a total of between 16 and 21. This 
finding suggests that the SNAP System has the. potential for making 
better use of large numbers of training alternatives, although it may 
also reflect differences in the decision making processes used by the 
SNAP System and the expert trainers. For example, the expert trainers 
tended to select particularly good training experiences and to recommend 
them for a number of teachers. The SNAP System simply looked at each 
individual case and selected sets of training experiences based on their 
ability to meet multiple training needs. 

Coverage of training needs . Based on the coding of the training 
options, the SNAP System met an average of 89% of the goals and 
subgoals, while the expert trainers met an average of 53%. The SNAP 
System met an average of 83% of the needs related to teacher 
effectiveness, while the expert trainers met an average of 67%. The 
SNAP System met an average of 50% of the needs related to attitudes, 
while the expert trainers r<»*. an average of 44%. This finding suggests 
that the SNAP System operates satisfactorily in covering training needs, 
but since the findings are based on the SNAP System coding, they should 
not be Interpreted beyond this. 

Phase Two 

The recommendations made by these three expert trainers and by the 
SNAP System were written in a uniform format, listing an identification 
number for the trainee and the training options recommended for that 
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trainee. As mentioned previously, all sets of recommendations for each 
trainee had a constant number of training experiences, ranging from 7 to 
12. This number was determined by the number of training experiences 
that were rated as "highly" appropriate by the SNAP System. 

It should be noted that the output of the SNAP System is In the 
form of "generators". These are clusters of training options separated 
by an ambersand, for example: 

option 1 
option 37 
option 123 

& 

option 14 

option 66 

option 180 

option 33 
option 99 

If one option is selected from each cluster, the maximum number of 
training needs will be met. In translating the recommendation of the 
SNAP System into a simple list of training options, we did not observe 
this format and thus may have put the SNAP System at a disadvantage. 
However, we felt that the expert trainers could not be asked to list 
their recommendations In generator format. 

Recommendations of the expert trainers and the SNAP System were 
Intermixed and presented to a second panel of expert trainers who 
evaluated the reconwiendatlons according to three criteria: (1) the 
completeness of the training recommendations In meeting individual 
training needs, (2) the absence of extraneous training experiences, and 
(3) the overall quality of the training recommendations. Each of these 
criteria was rated on a 5-po1nt scale with 1 representing the best 
rating and 5 the worst. 
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In comparison with the recommendations of the expert trainers, t;r.$ 
SNAP System achieved average rankings of 3.25, 2.97 and 3.39 
respectively on these three criteria. The SNAP System equalle'l or 
surpassed at least one expert trainer on 72% of the ratings for 
criterion (1), 72% for criterion (2), and 612 for criterion (3). These 
findings suggest that the SNAP System can successfully duplicate the 
functions of expert trainers In selecting training experiences. 

Discussion 

Evaluation components of the SNAP System measured how effectively 
the System used an expert system to prescribe training recommendations. 
Effectiveness In this section of the report refers to the validity of 
the SNAP recommendations as compared to recommendations of human experts 
and to the use of the SNAP recommendations as course assignments for 
teachers In a course on malnstreamlng. Evaluation findings support the 
use of the SNAP System as a method of prescribing training activities 
that are appropriate to the Individual Interests and needs of Individual 
teachers. 

Evaluation data do not suggest that the SNAP System Is superior to 
human expert trainers at recommending training activities. The SNAP 
System need not be superior to human experts. It need only produce 
training recommendations that are qualitatively comparable to the 
recommendations human experts might make. The use of an expert system, 
after all, can Increase the efficiency of the process. 

An Important consideration in evaluating the SNAP System is that 
its use Indeed fosters an individualized needs assessment and training 
process. Our evaluation activities suggest that the SNAP System may 
contribute to the efficiency and effectiveness of teacher inservlce 
training. With this view, the SNAP System may appear as a partner of 
inservlce trainers. Decision-making about appropriate experiences for 
individual teachers may be facilitated by the SNAP System, so that 
trainers are free to train. 
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c^aalocQ^ 

Stages of Concern Program. This program delivers and 
analyzes the Stages of Concern about Malnstreaming 
Questionnaire, using the revised SOC and the scoring 
algorithm described in the section on PROGRAM CONTENT. 
It should be a useful research tool as well as an 
Instrument for teacher training. 

Goal Setting Program. This program administers and records 
the self selection of learning goals, as described In the 
section on PROGRAM CONTENT. Its primary ui^e Is as a 
needs assessment Instrument for teacher training. 

Rules for Analyzing Teacher Self-Observations on the Basis 
of Research on Teacher Effectiveness. 

Data Base of Training Options 
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Note: These final two products form the basis of the two 
main expert system components of the SNAP System. 
Persons purchasing them will be able to Include them In 
expert systems using KES or a similar expert system 
development programs that are available. 
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Abstract 



This paper presents the rationale and general 
description for a computer-assisted needs assessment system 
for teacher training In special education. This system Is 
termed SNAP (Systematic Needs Assessment Program), and Is 
being developed and tested under a grant awarded by the 
Division of Personnel Preparation, Special Education 
Program. Office of Special Education and Rehabilitative 
Services, U.S. Department of Education. 

One Innovative feature of the SNAP System Is the 
application of "expert system" principles to Integrate and 
Interpret needs assessment data. These programming 
principles are drawn from the field of artificial 
Intelligence, and allow the computer to apply rules 
developed on the basis of expert input to guide the trainee 
through a selective process of needs assessment and 
self-exploration to arrive at recommendations of specific 
training experiences which will be of greatest benefit to 
the trainee. 



THE NEED BEING ADDRESSED IN THIS PROJECT 



Recent years have witnessed major Increases In the 
expenditure of money and effort to prepare educational 
personnel to meet the needs of handicapped students. 
Reasons include the Implementation of federal mandates, 
critical shortages In the supply of qualified teachers In a 
number of areas related to special education (Morsink, 
1982), questions about the qualifications of special and 
regular education teachers In light of new role functions 
and demands (Saluzzi, 1981), and a growing awareness of the 
need to build and maintain an Infrastructure of preservlce 
and Inservlce professional preparation In all areas of 
education (Hardin, 1982). By all accounts, these training 
needs pose great challenges for teacher training programs at 
both preservlce and Inservlce levels. 

This paper discusses weaknesses In current approaches 
to needs assessment In teacher training and describes the 
basic design principles for a microcomputer-assisted needs 
assessment system to be used in teacher training in special 
education. This system which has been termed SNAP 
(Systematic Needs Assessment Program), is being developed 
and tested under a grant awarded to the University of 
Maryland the Division of Personnel Preparation, Special 
Education Programs, Office of Special Education and 
Rehabilitative Services, U.S. Department of Education. 

The Need for New Approaches to Needs 
Assessment in Teacher Trainincj 

Any teacher training program must have a process for 
selecting training objectives and methods for the trainees ■ 
being served. Ideally, this process should provide a valid 
and direct answer to the question, "What training, 
experiences should the trainee be given?" This is a 
critical element, for the quality of training can be no 
better than the quality of this selection process. 
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However, in current practice the selection of teacher 
training experiences Is based upon needs assessment 
procedures which tend to use Insufficient data to make 
decisions which are too general, not Individualized, of 
questionable validity, and which are divorced from the 
actual procedures of training. The following sections 
describe the conceptual issues and methodological 
constraints which limit the effectiveness of needs 
assessment procedures In teacher training. 

Conceptual Issues 

There appears to be confusion over what exactly is 
meant by "need" and "needs assessment". Moreover, there are 
questions regarding the conceptual models underlying the 
practice of needs assessment. Scrlven and Roth (1378) 
stated the case quite strongly. 

Needs assessments have been for some time the most 
ludicrous spectacle In evaluation. The usual "models" 
are farcical and decisions based on them are built on 
soluble sand. (p. 25) 

Discrepanc y Model . One common needs assessment model' 
In special education teacher training I55 the "discrepancy" 
jjodel which conceptualizes "need" as the discrepancy between 
a "current status" and a "target status" (Popham, 1975b). 
This model is often operatlonallzed by collecting dual 
evaluations of (a) the Importance of a competency, and (b) a 
current level of the competency. Results are analyzed by 
calculating differences between the current and target 
ratings for each competency. Examples were described in 
Gable, Pecheone and Glllung (1981) and Phelps and Clark 
(1977). The discrepancy model may also be operatlonallzed 
by Identifying "quality" or "ideal" practices, and 
conducting a single assessment of the presence or 
Implementation of these practices. 
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Roth (1977) elaborated the basic discrepancy model by 
suggesting distinctions between different target states: 

1. goal discrepancy: the target Is an ideal. 

2. social discrepancy: the target Is a norm. 

3. essential discrepancy: the target Is a minimum. 

4. desired discrepancy: the target is a desire or 
want. 

5. expectancy discrepancy: the target is an 
expectation. 

The discrepancy model is conceptually simple, 
relatively easy to Implement* and compatible with a 
raanageraent-by-objectlve approach. Thus Its greatest uses 
may be in prioritizing training areas and nsaking 
administrative decisions about training programs. However, 
the discrepancy model has some Inherent conceptual 
weaknesses. Primarily, the discrepancy model captures the 
quantitative nature of the gap between actual and target 
states, but falls to encompass factors maintaining the gap 
or effecting Its possible reduction. In other words. It 
looks at the "hole" but not the "donut". 

For example, Scrlven and Roth (1978) distinguished 
between "performance deficits", treatment deficits", and 
"resource deficits". There may be an obvious discrepancy 
between a regular educator's ability to teach handicapped 
•students and the ability he/she should have. However, 
measuring the extent of this "performance deficit" provides 
no Information regarding the "treatment deficits" (e.g. 
previous training and administrative support) or the 
"resource deficits" (e.g. a^fallable assistance) which may 
contribute to the discrepancy. Thus, ths measurement of the 
discrepancy only partially answers the question of, "What 
training experiences should the trainee be given?" 
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Factor models. The following definitions of "need" 
differ from the discrepancy model: 

Z needs X = 2 would (or does) significantly benefit 
from X, and Z Is now (or would be without X) In an 
unsatisfactory condition. (Scrlven & Roth, 1978, p. 

ZS) 

...a factor without which a person or group or school 
system cannot adequately function. (Kuh, et al, 1980, 
p. 16) 

...something that can be shown to be necessary or 
useful for the fulfillment of some defensible purpose. 
(Stufflebeara, 1977) 

In the above three definitions, a need is a factor 
rather than a discrepancy. An unmet need, then, is the 
absence of this factor rather than a discrepancy between 
actual and target states. This type of definition partially 
answers the previous "donut and hole" criticism by 
encouraging a focus upon qualitative rather than 
quantitative aspects of an unmet need. However, needs 
assessments based on such "factor" definitions present 
certain difficulties. Such assessments require prior 
delineation of necessary or useful factors (Roth, 1977). 
This process is far from trivial in light of the complexity 
and variability of eaucational environments. The value of 
such factors may vary greatly for different teachers and 
situations. The presence or absence of a factor may not be 
readily discernable, but Instead may need to be inferred 
from multiple variables such as Instructional problems, 
teacher values, and available resources. 

A Conceptual Basis for the SNAP System 

Any attempt to develop a needs assessment system for 
teacher training should begin with the fundamental question, 
"What training experiences should the trainee be given?" No 
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single current conceptual model of needs assessment 
adequately encompasses the scope of this question. 

Discrepancy models are easily Implemented and can 
Identify areas of concern which may be Improved through 
teacher training. However, these models are relatively 
barren of Information necessary for the selection of 
training experiences. Factor models lend themselves to 
qualitative analysis of the training problem, but do not 
currently provide an adequate basis for the integration of 
different variables In determining needed training 
experiences. 

The SNAP system will incorporate elements of both 
discrepancy and factor models. Consistent with discrepancy 
models, training needs will be determined in part on the 
basis of discrepancies between actual and Ideal states. The 
use of "goal discrepancy" (Roth, 1977) will not limit the 
system to selecting training experiences required for 
adequate performance, but will also include training 
experiences to lead trainees at any level of functioning 
toward an Ideal target level of functioning. 

Consistent with. factor models, the system will be 
designed to select. training experiences which are "necessary 
or useful" (Stuff lebeam, 1977). The SNAP system will 
consider multiple variables (teacher attitudes, classroom 
events, available resources, etc.) In selecting these 
training experiences. 

Methodological Constraints 

Methodological weaknesses currently exist In (1) the 
collection of needs assessment Information, and (2) the 
processing and Interpretation of Information. These 
weaknesses can be further described as follows: 

1. Limitations In the collection of information . In 
current practice. If teacher training experiences are 



adapted to trainee needs at all, they are primarily selected 
on the basis of trainee self reports which are conducted by 
means of written questionnaires or (less frequently) 
interviews. Such methods are subject to the following 
criticisms: 

(a) Trainee self-reports tend to confuse "wants" with 
"needs," or "perceived needs" with "real needs" (Kuh, et 
al., 1980; Mann, 1980). For example, a regular education 
teacher may report a high need for training In categories of 
handicaps when In reality he/she would benefit more from 
training In Instructional methods for diverse students. A 
special education teacher may report a high need for 
training in content area Instruction when in reality he/she 
would benefit more from training in collaboration with 
regular content area teachers. 

Both affective and cognitive factors may contribute to 
this problem. A regular education teacher may report a high 
need for training in categories of handicaps oecause he/she 
ralstakenly overestimates the value of this Information in 
teaching handicapped students. A vocational education 
toache? may repo5*t a high need for training in equipment 
modification because he/she visualizes most handicapped 
st.uc3^:nts «s having physical disabilities and Is afraid of 
the occirrrence of Injuries. 

(b) Data collection proceaures tend to confuse "needs" 
and "goals". They do th<s b> asking trainees with limited 
knowledge of the training area to respond to items 
describing specific goals. For example, items taken from 
published needs assessment instruments ask respondents to 
rate their needs to learn more about how to do the 
following: 

(1) "Identify learning disabilities" 

(2) "Develop positive reinforcement techniques" 
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(3) "Employ techniques or principles of special 
Instruction (e.g., discrimination learning or 
cue redundancy)" 

In these Items, terms are employed which are likely to 
be misunderstood by the Intended audience. For example, the 
term "learnlny disabilities" Is often misused by regular 
educators as a general term for educational handicaps. 
Moreover, concepts In these Items require prior knowledge 
which Is not likely to be found among many training 
audiences. For example, to rate item 2, the trainee should 
know what "positive reinforcement techniques" are, what they 
do, how to recognize a ne«d for them, and If they are 
appropriate to his/her. setting. 

Why are such questionable Items used? One reason may 
be that they appear to relate directly to training. If a 
person reports a need for training in "positive 
reinforcement", then training ca.n be given on "positive 
reinforcement". In contrast, an item dealing wltv^ a need 
for "behavior management" may be more consistent with the 
trainee's initial knowledge and understanding, but does not 
suggest specific training experiences. Thus, information 
liraitations in current methodologies may force the trainer 
Into choosing between items which are appropriate for the 
trainees but have unclear Implications for training, or 
items which have clear implications for training but are not 
appropriate foi" the trainees. 

(c) Other types and sources of. 1 nf ormation are rarely 
utilized as completely as they should be. One valuable but 
frequently neglected type of information is the environment 
in which the problem or need occurs. Bronf enbrenner' (1979) 
argued for the ecological analysis of problems, including 
consideration of specific and general environments in which 
they occur. Teacher self-reports rarely address this type 
of information adequately. 
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Another underused source of Information Is the teacher 
performance test or observation (Popham, 1975a). What could 
have more obvious Implications for teacher training than an 
Inventory of current strengths and styles which can be built 
upon, and current weaknesses which should be corrected? 
However, for various technical and practical reasons, such 
Information Is rarely collected, much less used. 

2. Limitations In the processing and Interpretation of 
Information. F.ven If sufficient reliable Information were 
collected. It would be of little value unless It were 
processed and Interpreted appropriately. Weaknesses related 
to these functions Include the following: 

(a) Current methodologies are Inadequate for 
integrating and synthesizing large amounts of Information of 
different types collected from different sources (Mann, 

1980) . Consider a hypothetical case In which training 
decisions are to be made for 15 teachers on the basis of 
needs assessment Information consisting of self-ratings on 
30 possible perceived needs, observations regarding 20 
factors related to each trainee's teaching, and 20 factors 
in the school and community environments. This example 
represents both a substantial Increase from current needs 
assessments and a minimum when the Ideal Is considered. 
Processing and Interpretati ng these 1,050 pieces of data 
would constitute a formidable task for existing 
methodol ogles. 

(b) There are few validated principles upon which to 
base selection of teacher training experiences. Even with 
the availability of sufficient reliable information and a 
means to process It, there would be little basis for 
decision making. In rocent yearsg notable efforts have been 
made to Identify quality training practices (National 
Inservlce Network, 1980) and effective teaching procedures 
(Denham & Lleberman, Eds., 1980; Stevens & Rosenshlne, 

1981) . However, this Information represents a mere 



ERIC 



52 



beginning to the Information that Is needed. Further, 
general principles of teacher training and education are 
developed without attention to the conditions affecting 
their relative Importance and value. For example, research 
may suggest that effective Instruction Is teacher-directed, 
academically focused, individualized, and takes place in 
groups {Stevens 2 Rosenshlne, 1981). However, how does a 
teacher trainer decide If a specific trainee needs to learn 
methods for group Instruction, or Individual Instruction, or 
teacher direction? In which conditions Is each technique 
most important? How does one measure the level of need? 
And finally, how are these principles translated into the 
selection of specific training experiences? 

A Methodological Basisfor the SNAP System 

Current methodologies for needs assessment in special 
education teacher training are not adequate to collect and 
process the necessary Information. The SNAP system will . 
employ the information processing capabilities of the 
microcomputer enhanced with "knowledge-based expert system" 
programming principles to expand these capabilities. The 
following basic methodological principles will be observed: 

A. Collection of Information 

1. Multiple types of information will be employed, 
including student performance, teacher 
performance, and situational factors. 

2. To the greatest possible extent, each type of 
information will be collected from the best 
available source. For example, trainees will 
not be asked to respond to statements for which 
they may not have the necessary Informational 
background. Also, attitudinal and possible 
observational biases will, to the extent 
pos'sibl*?, be eliminated as sources of > 
misinformation. 



ERIC 



53 



B. Processi ng and Interpretation of Information 

1. Extensive and varied Information will be 
combined and Integrated In the process of 
selecting training experiences. 

2. Expert input and research data will be used 
intensively in the formulation of the decision 
rules used to select training experiences. 

3. The results of the needs assessment p"^ocess 
will be expressed in terms of specific training 
experiences which can be directly implemented 
and evaluated. 

4. A feedback mechanism w111.be Included to allow 
the continued development and revision of 
decision rules on the basis of trainee 
experience. 

Additional Design Considerations • 

In addition to consideration of the above conceptual 
and methodological issues In needs assessment, the SNAP 
system will be designed to allow needs assessment to become 
an on-going, responsive and integral component of the 
training process, consistent with principles of teacher 
development and adult learning such as the following: 

1. Teacher needs change qualitatively and 
quantitatively during the course of teacher 
develppment (Fuller, 1969; Hall i Loucks', 1978). ■ 
Such chane,es have important Implications for the 
process of teacher training and should therefore be 
monitored on an on-going basis. At an appropriate 
level of development, needs assessment proceduj^cs 
win be capable of serving this function. 

2. Needs assessment itself should be an educational 
process (Kuh, et al., 1980). As such, the process 
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should conform with principles of adult learning 
such as the following (Banks, 1981): 

(a) Learning should be self-directed. The SNAP 
system will treut the trainee as an active 
participant In the assessment process by 
providing frequent feedback and by providing 
explanations for assessment decisions. The 
trainee will be able to trace the consequences 
of various types of Input, and to provide 
feedback regarding the validity of the system. 

(b) Learning should tap the adult learner's 
previous experience. As adults, teacher 
trainees have an accumulation of previous 
experiences to whiCh they tend to relate new 
learnings and which can serve as a foundation 
for training. The SNAP system has the 
capability of Including previous experience as 
a factor in the decision-making process while 
at the same time including a variety of other 
important factors. 

(c) Learning should be problem-oriented. The 
trainee should recognize the direct relevance 
of training to solving problems or performing 
tasks that are required of him/her. In some 
cases, the trainee may need to be shown this 
relevance. The SNAP system will conform to 
this principle in two ways. First, it will 
select training experiences which will be of 
use to the trainees. Second, jt will allow 
the trainee to see the relevance of training 
selections by providing feedback and 
explanations during the course of assessment. 

The above principles are sometimes misconstrued to 
support an adult version of a "free schooV in which needs 
assesi5,!nent v^ould simply involve asking the trainee, "OK, 
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what do you want to learn?" The process Is In fact mce 
complex that this, and requires a needs assessment system 
which can be both flexible and structured, both interactive 
and directive, and which can accept assessment data 1r. the 
available forms and provide feedback a.id recommendations ' 
based on expert Insights. 

Summary of the Need and Design 
Considerations for the SNAP System 

Needs assessment approaches In teacher training are not 
currently adequate for performing the functions for which 
they are Intended. Conceptually, they are unable to 
Integrate and encompass all aspects of the fundamental 
question, ^What training .experiences should the trainee be 
given?" Methodologically, they are limited by the Inability 
to collect and process the Information needed to select 
training experiences. The SNAP system Is an attempt to 
exploit the capabilities of microcomputers .In collecting, 
storing and processing Information to allow needs assessment 
procedures to perform t^e1r Intended functions more 
completely and consistently with principles of teacher 
development and adult learning. 

INITIAL DESCRIPTION OF THE 
SNAP SYSTEM 

Many features of the SNAP system have not yet been 
determined, thus the following description (based on initial 
proposed plans) should be considered as tentative.. 

The Functions of the Microcomputer 

The microcomputer will be central to the needs 
assessment process. The most innovative function will be to 
serve as an "expert system." As such, the SNAP system will 
duplicate to a limited degree the process of expert 
consultation that might be provided If each teacher trainee 
were able to engage in an extended Interaction with a panel 
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of experts. We do not propose to develop a "state of the 
art" expert system, but instead intend to focus on the 
application of existing products and technology to a new 
task. 

The expert tasks to be performed by the system can be 
characterized as: (a) To monitor the needs assessment 
process and make selections of items or tasks on the basis 
of multiple rule elements, (b) To select training 
experiences for Individual trainees on the basis of a large 
quantity and variety of collected data. 

Characteristics of the Expert System 

The proposed system has a number of significant design 
characteristics relevant to expert system development. 
These include the following: 

1. Relat ively small solution space . We anticipate an 
initial system design which will have the capacity for 
differentially selecting training experiences from a 
"solution space" of approximately 250 to 300 specific 
training alternatives. This represents our best estimate of 
an appropriate balance between manageability and 
nontrlvlallty fn Initial system development. If the 
approach proves to be successful, there Is virtually no 
limit to the number of training alternatives that can be 
included In a solution space. 

2. Microcomputer Implementation . Until recently, 
rule-based systems have been designed to' run on large 
main-frame computer systems. However, recent systems run 
quite effectively on microcomputers. This is largely due to 
advances that have occurred In computer hardware technology.* 

3. Produc tion rule structure . The representation of 
knowledge within computer systems is a matter of continued 
development In the field of artificial Intelligence. Our 
initial plans are to employ production rules which can be 
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viewed as IF-THEN rules. Each rule Is generally formulated 
to represent a "chunk" of knowledge. Kg-jx systems contain 
hundreds of such rules arranged Into networks according to 
the relationships between rules. 

4. Systematic uncertainty. One problem we face In 
developing the proposed system Is the unavoidable presence 
of (a) uncertainty in the production rules, and (b) 
unreliability in the needs assessment data collected. The 
problem of Inexactitude has been faced In the development of 
other rule-based expert systems. 

Davis, et al., (1977) describe use of "certainty 
factors" In the MYCIN system to accomodate the judgemental 
and Inexact nature of medical diagnostic rules. An example 
Is provided in the following INTERLISP code: 

premise: ($AND(SAME CNTXT INFECT PRIMARY-BACTEREMIA 
(HEMBF CN-^XT SITE STERILESITES ) 
(SAME CNTXT PORTAL GI) 

action: (CONCLUDE CNTXT IDENT BACTEROIDES TALLY .7) 
English translation: 

If (1) the infection Is primary-bacteremla, 
and 

(2) the site of the culture is one of the 
sterllesltes, and 

(3) tf:e suspected portal of entry of the 
organism Is the gastrointestinal 
tract, 

then there is suggestive evidence (.7 out of 
1) that the Identity of the organism Is 
bacteroldes. 

The certainty factor in the above rule Is 0.7. These 
factors can vary from -1 (complete disbelief) to +1 
(complete belief). The certainty of a hypothesis is the 
algebraic sum of the certainty of evidence for and against 
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It. One advantage of this particular model of inexact 
reason Is It allows the simultaneous accumulation of 
evidence supporting and against a giver .^pothesis. 
Shortllffe and Buchanan (1975) describe the model In detail. 

The above approach to uncertainty has been criticized 
as possibly being "unnecessarily ad hoc" in that the 
developers of MYCIN have formulated their own model of 
Inexact reasoning when there are other, more 
throughtly-studled models available (Steflk, Alkens, Balzer, 
Benolt, Birnbaum, Hayes-Roth, and Sacerdoti, 1982). Another 
alternative would be to apply Bayes' Rule to calculate the 
probability of a disease In light of evidence and 
conditional probabilities. The main difficulty with this 
approach is the quantity of data required to determine 
conditional probabilities. A compromise approach described 
by Ouda, Hart, and Nilsson (1976), and Pednault, Zucker, and 
Muresan (1981) Involves the use of subjective estimates 
rath'er than rigorous data to determine probabilities. 

Control Strategy and Data Input . There are two basic 
processes for applying the rules in the rule-based system to 
a given set of data (i.e. problem). One approach is termed 
"forward chaining", "antecedent reasoning", "data driven", 
etc., and the other approach is termed "backward chaining", 
"consequent reasoning", "goal driven", etc. (Duda & 
Gaschnig, 1931). These two basic approaches are sometimes 
found In combination. 

In the forward chaining approach, the Initial data are 
scanned until a rule is evoked. This rule is applied, 
leading to a change in the data base, and the scanning 
resumes. This process continues until a goal Is reached. 
An exairple of this approach can be found in the INTERNIST 
system for medical diagnosis. In this system, an initial 
set of symptons and other data evoke a set of disease 
hj^potheses. For each hypothesis, the system begins to 
accumulate evidence consistent with the hypothesis, evidence 

* 
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contradictory to the hypothesis, and evidence which should 
be observed If the hypothesis Is correct. Eventually, 
supportive and contradictory evidence accumulate to the 
selection of a most likely disease model and treatment 
(Kullkowski, 1980). 

In the reverse chaining approach, rules are scanned 
consistent with a given goal. If antecedents are found to 
match the predicates of the rule, then the problem is' 
solved. If not, then the new goal becomes the arrangement 
of antecedents to m^tch the requirements of the rule, and 
the process continues. An example of this approach can be 
found in the MYCIN systera for medical diagnosis. In this 
system, goals are diagnostic conclusions. If a goal is 
evaluated successfully (a certainty factor greater than .2) 
the conclusion is made. If the goal is evaluated 
unsuccessfully, it is bypassed. If the goal cannot by 
evaluated, the evaluation of the goal becomes a new subgoal 
and the process continues (Davis, et al., 1977). 

Both control strategies call for a degree of 
interaction between the expert system and the person being 
"advised." initial data will be entered, the system will 
apply rules, more data will be requested, more rules will be 
applied, and so on 'jntil solutions have been found. The 
following exampU is taken from the PROSPECTOR systera which 
applies both for"ward and reverse chaining approaches (Duda & 
Gaschnig^ 1981): 

Computer:- To what degree do you believe that the 
target area is in a continental-margin mobile belt? 

Person: 4 

Computer:' Do you know the age of the 
continental-margin mobile belt? 

Person: WHY 
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Computer: The vast majority of porphyry copper 
deposits are younger than 200 million years. Major age 
groups Include. ..<The computer explanation 
cont1nues>. .. 

Computer; Do you know the age of the 
continental-margin mobile belt? 

Person: YES 

Computer: What Is the age of the continent?' -margin 
mobile belt? 

Person: CRETACEOUS = 65 - 136 MILLION YEARS 

Computer: What Is your confidence In this estimate? 

Person: 3 ...<The consultation cont1nues>. . . 

Flnsl decisions have not been made regarding the 
control strategy of our proposed system. We currently 
anticipate that both forward and reverse chaining strategies 
will oe employed. 

In contrast to some other rule-based expe'rt systems, 
the trainee will not come to the computer with answers to 
all of the questions that may be asked. Thus the 
Interaction between trainee and computer will be 
discontinuous. The initial needs assessment tasks wtll 
include an interactive survey of perceived needs, structured 
school-based observations, and entry of the results of these 
observations into the computer. The computer will then. • 
select other questions and assessment tasks, and the trainee 
will answer the questions and/or make further observations 
for later entry into the computer. This "punctuated 
interaction" will take place over a minimum of two or three 
sessions and will be structured with frequent feedback to 
maximize its value as a learrning experience. 
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Learning Goals 
Instructions -for the Questionnaire 

Please rate the degree o-f use-fulness that each learninq goal 
would be -for you on a scale o-f 1 to 5 <l=not use-ful ; 
2«sllghtly use-ful ; 3=moderatel y use-ful ? 4=hiQhly use-ful j 
5=essent i al ) . 

Tor example: 

This learning goal is not use-ful to me now. 1 2 3 4 5 1 
This learning goal is essen^:ial to me now. 1 2 3 4 5 5 

i 2 3 4 5 

NOT SLIGHTLY MODERATELY . HIGHLY ESSENTIAL 

USEFUL USEFUL USEFUL USEFUL 

I would like to learn more about. . . 

1. special education procedures in my school 



2. speci-\l education services that are available 
in general 

3. approaches to working with special education 
students 



4. 



the types and characteristics o-f students served 
in special education 



5. the learning problems that students can have in 
school 

6. how to obtain instructional help in my classroom 
^rom special educators 

7. how to use classroom aides 

8. how to gain access to instructional materials, 
equipment, etc. -for mainstreamed students 

9. how to obtain additional in-formation about 
mainstreamed students in my class 

10. how to work with other educators on tasks 
relate to mai nstreami ng 
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how to select and adapt materials to teach 
students who have trouble learning 



12. how to teach students who are having trouble 
1 earn i ng 

ER?C ' fig 



1 2 3 4 5 

NOT SLIGHTLY MODERATELY HIGHLY ESSENTIAL 

USEFUL USEFUL USEFUL USEFUL 

I would like to learn more about, . , 

13. how to encourage desirable social interactions 
between special education and non-special 
educat i on studen ts 

14. how to provide instruction -for slower students 
without disrupting instruction -for other students 

15p how to analyze student learning problems to 

determine how to deal with them 

16. how to deal with the issue o-f grading students 

•fairly when they vary widely in ability 

17. how to keep better track o-f how students are 

doing in my class 

18. how to'det^rmine students'' skill level In 

relation to what I teach 

19. how to determine students^ study skill levels in 
relation to what I teach 

20. how to interpret assessment results in a 
student^s records 

21. the behavioral and motivational problems that 
students can have in school * 

22. how to identify students with behavioral or 
mot i vat 1 on al probl ems 

23. how to deal with students^ behavioral or 
mot i vat i onal probl ems 

24. how to confer with parents 

25. why I should be working with special education 
studen ts 
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SNAP Self-Observations 



This pac!-'tt contains the self-observation forms and 
directions that you will need for phase 2 of SNAP needs 
assessment. Before you go any farther, please take heed of 
the following advice: 



1. The observations do not need to be done in 1-2-3 order. 
Preview the entire packet, then select the observation 
you would like to do first. 

2. The class list with performance rating, which 
accompanies Observation #2, must be filled out for both 
Observation #2 and #3. To protect the anonymity of your 
students, you may use first names with or without 

1 ast name initials. 

3. Read directions to an observation form and examine the 
form itself very carefully before performing a self- 
observat i on . 

4. Select typical school weeks for observations — typ i cal 

in the sense of the usual interruptions for this time of 
the year. 

5. Observation periods of 5 days are best, but 4 days may 
suffice. A week of observing does not have- to beqin on 
Monday; if you begin on a Wednesday, end on the next 
Tuesday. 

6. Keep al 1 records of your observations, all labeled with 
dates, limes, class periods, etc. Bring your records, 
i.e., sel f-obser-^vat i on forms, to your scheduled computer 
sessi on . 

SECONDARY TEACHERS AND ELEMENTARY SPECIALISTS: 

- Observation #1: Use the word "planning" on top and 
bottom sections of form to indicate times you have 
planning period, team meetings, etc. "Planning" 
belongs in the "purpose" blank and the "topic" blank. 
Also, please mark (with an asterisk) the times you 
were teaching students whom you observed in Observa- 
tions #2 and #3. 

- Observations U2 and **3 iiould be of the same 
c 1 ass. 

EVERYONE: 

If you need HELP, contact either Jennie Pilato or 
Jackie Haynes at 454-6921, or at our home numbers: 

Jennie - 490-3403 (Laurel) 

Jackie - 279-2217 (Rockville) 
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Directions for Observation 1 



This instrument may be used as a self-observation, or 
it may be done by someone else. The purpose of the 
observation is to determine how much of the school day i 
allocated for instruction, and how much of i t i s actually 
used for direct instruction. 

The observation period last'- for one week at a time. 
It may be repeated several times throjghout the school year 
to account for seasonal variations in school schedules 
(such as Christmas festivities, Spring outdoor activities, 
etc . ) . 

If you are using Observation 1 as a se 1 f -observat i on , 
begin by selecting a week for the observation that has a 
full five days of school attendance. Make sure you have 
five copies of the observation form (one for each day), and 
that you understand the directions thoroughly. 

Each day, begin by completing the information requested 
at the top of the page regarding day (of t^e week), grade, 
subject (if elementary and non-depar tmen tal i ired, leave 
blank; otherwise, indicate the specific subject you teach), 
beginning an'd ending times of the scheduled school day, and 
the number of students in attendance on that day . 

Throughout the day, each time the activity changes, 
record the event if it is either "out-of-cl ass" time (lunch, 
recess, assembly, PE, music, etc.), or "teaching time," (a 
period where you, the teacher, are teaching either a 
subgroup or the whole class). For both of these, indicate 
the beginning time and ending time of the activity. 
Indicate the actual times of the activities? not including 
time required for transition to the activity, moving through 
the hall, etc. For teaching time, indicate the number of 
students to whom your specific instruction is dii^ected (the 
12 students in a reading group, 24 of the 30 students in 
your class if the other 6 are working on a group project at 
that time, etc.). Be as specific as possible in indicating 
the topic of instruction (adding S-digit numbers, compound 
words, etc . ) . 

If additional sheets are needed, simply indicate the 
day of the week and your name at the top of the second 
sheet . 

For the greatest degree of accuracy, complete the 
starting and stopping times as they occur, and the rest of 
the information as quickly as possible upon completion of 
the activity. Your accuracy in reporting times is important 
to the validity of this instrument. 
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Ob5(?rvat i on 1 



Days 



Teacher ; 



Grade : 



Av/^rage class size:. 
School beoins: 



Out-of-class times: begin:, 

end:^ 
purpose :_ 

begi n :^ 
end:_ 
purpose :^ 



^ Observer :. 
Subject : 



No. of subgroups:. 
School ends: 



begi n :. 
end:^ 
purpose 

begi n :_ 
end:, 
purpose :^ 



Teaching time: 



#1 



begi n :. 
end: 



#studen ts :. 
top i c : 



begi n :. 
end : 



^students:, 
top i c : 



#2 



#3 



begi n :^ 
end: 



#studen ts:_ 
top i c : 



#5 



begi n :. 
end: 



ttstuden ts:, 
top i c : 



beg i n :. 
end: 



^students:, 
top i c : 



begi n :. 
end: 



#studen ts :_ 
top i c : 



#4 



^6 



#7 



begi n :^ 
end: 



^students:, 
top i c : 



begi n 
end: 



^students':, 
top i c : 



#8 



a? 



begi n 
end: 



Sstuden ts:^ 
top i c : 



begi n :_ 
end: 



Sstuden ts:, 
top i c : 
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Directions for Observation 2 



This instrument may be used as a sel f^-observat i on , or 
it may be used by someone who is observing in a classroom. 
The purpose ot this observation is to determine the pattern 
of response opportunities offered to students. 

The observation period lasts for one week, two times 
per day. Each observation period should last for 
approximately 15 minutes and should coincide with activities 
where you will be interacting frequently with the students. 
The procedure may be repeated several times throughout the 
school year to account for variations determined by 
students'' studying different content areas taught through 
different media or teaching styles. 

If you are using Observation 2 as a se 1 f -observat i on , 
begin by selecting a week for the observation thct has a 
full five days of school attendance. Make sure yos have 
sufficient copies of the needed forms for bol.^ whole class 
and group observations for the entire week, and be certain 
that you understand the directions thoroughly. 

Observation ti-mes should be selected each day so that 
over the course of the week observations will be obtained 
for a representative sample of the. various teach i ng^l earn i ng 
situationr> which occur in your classroom. Elementary 
general ists should choose mornings and afternoons, large and 
small groups, a variety of small groups, academic and 
non-academic content areas, and a variety of" academic 
content areas (language arts, math, social studies, etc.). 
Secondary teachers and elementary specialists should observe 
the same class each day but do observations of different 
times in the class period and different types of 
instruction, such as small group and whole group teaching. 

After you have selected the instructional settings you 
wish to include, prepare a seating chart for your entire 
class, leaving ample space in each block to record stu.de.nt 
interactions. Samples of several types that can be used 
successfully are attached. Copy your seating charts so that 
you have enough copies to last for the week (unless you 
expect to change seating arrangementf> within the observation 
period). For observations to be conducted with small 
groups, either a seating chart or simply a list of group 
mei.ioers may be used, depending upon the size of the qroup, 
seating practice (assfjned or unassigned), and other "factors 
that will influence the convenience of tr^e observation form 
for you. 

Complete the class list form at the beginning of the 
week for all students that you teach. The estimate of 
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overall performance level should be your own beli*-fs 
independent o-f test scores, grades, etc.) about their 
actual per-formance, not potential or ability level. 

At the beginning o-f an observation period, -fill out the 
coversheet -for the observation. Class size should indicate 
the number o-f studr-ts actually in attendance at the tim^ o-f 
the observation (n^c including those who may be absent 
school, at band, working with a specialist, etc.). Group 
size should indicate the same i n-f ormat i on , i -f you are 
observing the instruction o-f a qroup within the class. Then 
indicate whether the observation is a whole class or group 
observation. , 

Select a seating chart or list that corresponds to the 
situation you are observing. Using the appropriate seatinq 
cliart or list, "X" out any individuals u.io are not present 
at the time of the observation. Then begin your normal 
instruction. Then proceed as follows, depending on the day 
of the week: 

Monday. [We dnesday. Friday 

As students respond, indicate either in the block 
incicating their seat or the line next to their name the 
type of response. Use the appropriate code indicated on the 
observation sheet. Write a "Kf" if the response is 
voluntary, "R" if it is recruited, "0" if the student is 
responding in a designated order, "Q" if the student asks an 
unsolicited question, and "C" if the student makes an 
unsolicited comment. The order of these on the seating 
chart IS unimportant. Continue coding student responses as 
they are given until the time for the observation is over. 

Tuesday. Thursday 

As students respond, indicate either in the block 
indicating their seat or the line next to their name the 
correctness of the response. Use the appropriate cods 
indicated on the observation sheet. Write "A" for an 
appropriate response, "I" for an inappropriate response, 
DK" for a "don't know" response or no response. Note that 
these may be right or wrong answers to questions that have 
such answers, or they may be comments or responses 
indicating a student's understanding of a higher-level 
question that has no explicit right or wrong response. 
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Day: 

Starting time:, 

Ending t i me : 

Class size: 

CV ass/Group 1 esson : 



Observat i on 2 
Covershee t 

Teacher :_ 

Grade: 

Subject 

No. of subgroups: 

Gruup size : 



Student Response Codes: (Monday, Wednesday, Friday) 

V — voluntary response (hand raised, or 
other means o-f volunteering a 
response are indicated) 



R — recruited response (the student's 

response was requested by the teacher 
without the student giving any 
indication that he/she wants to 
respond) 

0 — ordt^red turn (the student was 
responding in turn without any 
c on si de rati on given to any 
students desire to repond or 
not respond) 



Q ' — the response is a question by the 
student whi»:^h was not solicited by 
the teacher 

C — the response is a comment by the 

student which was not solicited by 
the teacher 

Student Response Codes (Tuesday, Thursday) 

A — the response is appropriate -for 

the question asked. It is either 
correct, or indicates that the 
student -fully understands the content 
o-f the question and responds 
accurate 1 y . 

I — the response is i nappropr i ate -for 
the question asked. It is either 
incorrect, or indicates that the 
student dees not understand the 
content o-f the question and is 
unable to respond accurately. 

DK — the students responds th .t he/she 
does not know the answer to the 
question(s) asked, or re-fuses to 
respond to the question. 
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Class List -for Obser^' at i on 2 
^^rue Performance* Name Perrormance* 



1 .. 


19. 


2 , 


20. 


3. 


21 . 


4. 


22. 


5. 


23. 


6. 


^.4. 


7. 


25. 


S. 


26. 


9. 


27. 


10. 


28. 


11. 


29 


12. 


30. 


13. 


31 . 


14. 


32. 


15. 


33. 


16. 


34, 


17. 


35. 


'8. 


36. 



*Per-form:.nco - identify as "higii", "medium", or "low" 
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Instructions -for Observation 3 



The purpose of this self observation is to galher 
information about the proportion of time students are 
actually engaged in learning activities and their success 
1 evel . Research on student ach i evement indicates that 
"engagement rate" is a good predictor of student 
achievement, particularly when it is combined with students^ 
success level and the overall amount of time spent in 
learning activities. For this observation, you will be 
collecting information about the engagement rate of six 
students. The observation will take place over the period 
of one week (five school days). Before beginning the 
observation, make sure that you have enough copies of the 
observation form. You will need tujo sets of forms for each 
day. The specific procedures are outlined below: 



1. Each day, select two time periods of ten minutes each 
when it will be possible for you to observe the studei;ts you 
selected. These should be times that you will not be 
involved directly in teaching, since conducting the 
observation will require your attention. These time periods 
can be either during independent seatwork, when an aide or 
student teacher is teaching, or at another time that seems 
su i tabl e to you . 

2. At the appropriate time, take the coding sheet for 
Observation 3, and fill in the activity description 
information at the top of the page. Be as specific as 
possi b1 e . 

3. Sit where you can see all of the specified students, or, 
if it is your normal practice, circulate around the room so 
that you will be able to see what the specified students are 
doing. DO NOT INFORM THE STUDENTS THAT THEY ARE BEING 
OBSERk^ED. Also, sit where you can see a clock with a second 
hand, or wear a watch with a second hand. 

4. Once each minute, for a total of ten minutes, indicate 
on the coding sheet for Observation 3, FOR EACH OF THE SIX 
STUDENTS whether the student is 

on task — actually engaged in performing 
appropriate tasks related to learning the content of the 
instructional activity. Examples of on--task behaviors might 
be: writing an answer, reading an appropriave selection 
from the text, thinking about an answer, measuring, cutting, 
discussing, or listening. Of course, many of the decisions 
you will make about whether or not a student is on-task will 
be inferred from their overt behavior. For example, if a 
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student^'s eyes are directed toward a book, you would 
probably infer that he/she is reading, although it is 
entirely possible that he/she is only staring at it while 
thinking about their vacation or tonight^s party. 
Similarly, if a student seems to be daydreaming for a period 
of time, it is possible that he/she is deeply engrossed in 
performing a problem-solving task, or attempting to remember 
an important fact. Sjmply make the best guess you can about 
the student's behavior. 



related — the student is on--task, but is not 
performing the actual learning tasks associated with the 
activity. Examples of related activities would be finding 
the right page, sharpening a pencil, waiting for a CAI 
program to load, reading directions, finding the right page 
in a book, etc. These activities are both appropriate and 
necessary .for performing the learning activities, but are 
not part of the learning itself. 

off task — the student-'s current behavior is not 
related to the learning tar^k assigned. The behaviors may or 
may not be disruptive, and may or may not be appropriate for 
some other learning task (such as doing math homework when 
he/she is supposed to be writing spelling words), but is not 
appropriate for the specific, assigwed task. 

For each minute of the 10-minute observation period, 
one of these choices will be indicated., If it is 
impossible to observe a student for one of these time 
slJces, put an X over the entire block. At the completion 
of the 10-minute observation period, indicate any additional 
comments you have about a particular student. 

If it will help you, you may write the name of the 
student on top of the corresponding student number for each 
time slice, or at the top of each page. Make sure, however, 
that th-e student number corresponds to the number given t^ 
you by the computer for that student. This is important 
because the computer will be using its database about 
specific students to evaluate their engagment rate. 

Following each 10-minute observation period, collect 
the work that the student was doing, and give an overall 
rating as to whether the student^'s success at the task 
he/she was performing was high, medium, or low. These are 
overall, subjective evaluations, but should follow the 
general guidelines as follows: 

High success — 90X or more correct responses 
Medium success — 75/i - 907. correct responses 
Low success — le^s tNan 75'/. correct responses 
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.hese gu.del.nes can be bc^sed on evaluations of written 

dur^; °^k'''^^°"^^^ Q'"^"" ^t'^dents to quest i ons Isk^S 
during the observed instructional period! 

.ro.?b:errt^rn%^irir?rJerd"ed!° ^"^^^ 
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Act i V i ty ; 
Ulhole ctass 



Teacher-d i rec ted, 
Descr i pt i on ; 



Observa.tion 3 



Group. 



Group work_ 



Indi v i dual 



.Independen t. 



T i me Samp 1 e 1 
Student 1 



Student 2 



Student 3 



On task 

Related 

0-f-f tsk 



.On task 
.Rel ated 
.0-f-f tsk 



.On task 
Related 
0-f-f tsk 



Student 4 

^On task 

Rel ated 

0-f-f tsk 



Student 5 

On task 

Related 

0-f-f tsk 



Student 6 

_0n task 
_Rel ated 
_0-ff tsk 



Time Sample 2 

Student I 

On task 

Rel ated 

O-f-f tsk 



Student 2 

On task 

Related 

__0-f-f tsk 



Student 3 

On task 

Related 

0-f-f tsk 



Student 4 

On task 

Rel ated 

Oii tsk 



Student 5 

On task 

Rel ated 

0-f-f tsk 



Studen.t 6 

JCn task 
_Rel ated 
_0-f-f tsk 



ERIC 



^2 



Time Sample 3 



Student 1 



Student 2 



Student 3 



On t&sk 

Rel ated 

0-f-f tsk 



On task 

Rel a ted 

0-f-f tsk 



On task 

Related 

0-f-f tsk 



Student 4 

On task 

Rel ated 

0-f-f tsk 



Student 5 

On task 

Rel ated 

0-f-f tsk 



Student 6 

J3r\ task 
.Related 
_0-f-f tsk 



Time Sample 4 



Student 1 

On task 

Rel ated 

0-f-f tsk 



Student 2 

_„0n task 

Rel ated 

Of-f tsk 



Student 3 

On task 

Related 

0-f-f tsk 



Student 4 

On task 

. Related 

_ 0-f-f tsk 



Student 5 

On t ask 

Rel ated 

0-f-f tsk 



Student 6 

_0n task 
_Rel ated 
_0-f-f tsk 



Time Sample 5 

Student 1 

On task 

Rel ated 

0-f-f tsk 



Student 2 

On task 

Rel ated 

0-f-f tsk 



Student 3 

On task 

Rel ated 

0-f-f tsk 



Studert 4 

On task 

Rel ated 

0-ff tsk 



Student 5 

On task 

Related 

0-P-f tsk 



Student 6 

_0n task 
_Rel ated 
0-f-f tck 
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Time Sample 6 



Student 1 

On task 

Rel ated 

Off tsk 



Student 4 

On task 

Rel ated 

^Off tsk 



Time Sample 7 
Student 1 

On task 

Rel ated 

Off tsk 



Student 4 

On task 

Rel ated 

Off tsk 



Student 2 

On task 

Rel ated 

Off tsk 



Student 5 

On task 

Rel ated 

Off tsk 



Student 2' 

On task 

Related 

Off tsk 



Student 5 

On task 

Related 

__Off tsk 



Student 3 

On task 

Related 

Off tsk 



Student 6 

_0n task 
.Related 
_Off tsk 



Student 3 

On task 

Rel ated 

Off tsk 



Student 6 

_0n task 
_Rel ated 
Off tsk 



T i me Samp 1 e 8 

Student 1 

On task 

Related 

Off tsk' 



Student 2 

On task 

Rel ated 

Off tsk 



Student 3 

On task 

Rel ated 

Off tsk 



Student 4 Student 5 Student 6 

— On task On tasic _0n task 

— Related Related .Related 

— tsk Off tsk Off tsk 



er|c ' ^4 



Time Sample 9 



Student 1 



Student 2 



student 3 



On task 

Re' ated 

0-f-f tsk 



.On task 
Re 1 ated 
0-f-f tsk 



On task 

Rel ated 

0-f-f tsk 



Student 4 

On task 

Related 

0-f-f tsk 



Student 5 

On task 

Rel ated 

0-f-f tsk 



Student 6 

_0n task 
_Re1 ated 
0-f-f tsk 



Time Sample 10 

Student 1 

On task 

Related 

Of-f tsk 



Student 2- 

On task 

Rel ated 

0-f-f tsk 



Student 3 



.On task 
Rel ated 
0-f+ tsk 



Student 4 

On task 

Rel ated 

0-f-f tsk 



Student 5 

On task 

__Rel ated 
0-f-f tsk 



Student 6 

_0n task 
_Related 
0-f-f tsk 



Success 1 eyel ; 

Student 1. 
Student 2_ 
Student 3 



Student 4_ 
Student 5 



Student 6 



Comments: 
Student 1 ; 
Student 2: 
Student 3; 



Student 4; 
Student 5: 
Student 6: 
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i^pendix D 

Descriptive Sur^/ey and 
Attitudes Toward Mainstreaming 
Scale 



PS 



E^i2£ME!^T OF THE ATTITUDES TOWARD MAINSTREAMING SCALE 



The purpose of the Attitudes Toward Malnstreaming Scale (ATMS) Is 
to provide a measure of a regular education teacher's attitudes toward 
malnstreaming and handicapped students. It supplements the Stages of 
Concern scale, as modified by our project. In determining If a need 
exists for training to change attitudes. We began the development of 
the ATMS by reviewing existing attitude scales, particularly the scale 
used by Larrlvee and Cook (1979). Following this review, we collected 
and formulated 10 items for an Initial test. This test Involved 53 
regular education teachers who responded to the 10 Items in a paper ani 
pencil format. 

The first Item In this Appendix Is a hard copy of the screen 
displays for the Descriptive Survey and ATMS. Following this, we have a 
copy of the 10 original items, along with a statistical breakdown of the 
responses to the ten Items, the means and standard deviations, 
Intercorrelatlons, and a factor analysis. Six of the 10 Items were 
selected for Inclusion In the final form of the ATMS. Four Items were 
d1scard6<1 because of low correlations with other Items, low standard 
deviations, and/or poor loading Into any of the factors. 



Er|c ^ ^7 



You are about to complete the "Stages of Concern 
about flainstreaming" questionnaire. This questionnaire 
was developed by The Institute for Study of Except- 
ional Children and Youth of the University of 
Maryland, It is modified from the original 
"Stages of Concern" questionnaire developed 
by Dr. Gene Hall and his colleagues of the University of 
Texas at Austin. 

First, please respond to >he questions that 
follow which describe your current role and status 
as an educator. 

Type F "enter" to move to the next page. 



C CHANGES RATING 



S SMARTS PROGRAM 
D GETS DIRECTIONS 



F PAGES FORWARD 
B PAGES SACK 



Enter ths number (followed by the "enter" key) 
of the response that best describes you. 



1. Sex 



2. Age 



Male (1) 
Female (2) 



20-25 : (1) 

2-^-30 : (2) 

:^"35 : (3) 

36-40 : (4) 

41-45 : (3) 

46-50 : (6) 

51-55 : (7) 

56 or above 



(8) 



C CHANGES RATING 



S STARTS PROGRAM 
D GETS DIRECTIONS 



F PAGES FORUARD 
B PAGES BACK 
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Enter the number (followed by the "enter" key) 
of the response that best describes you. 



3« Current role 



4. Current level 



(1) Regt'iar Teacher 



(1) Preschool 



(2) Spec .1 Education Teacher (2) Primary (K_3) 

(3) Administrator or Supervisor (3) Intermediate (4 6) 



5. Years of experience in current role : 

6. Total yes^s of experience in education : 

7. Uhat training have you had in special education?; 

(1) None 

(2) One course or workshop 

(3) Tuo to four courses or workshops 

(4) More than four courses or workshops 

(5) Certification or degree in special education 



(4) Other 



(4) Hiddle-Junior High (6„9) 

(5) Senior High (9 12) 

(6) K-12 



C CHANGES RATING 



S STARTS PROGRAM 
D GETS DIRECTIONS 



F PASES FORWARD 
B PAGES BACK 



C CHANGES RATING 



S STARTS PROGRAM 
D GETS DIRECTIONS 



F PAGES FORUARD 
B PAGES BACK 



ERIC 



Enter the number (folloufd by the ''enier*' key) 
of the response that '^est describes you* 



8v Experience teaching special education studen+s : 

(1) Very little or no experience 

(2) Regular class^*^ uith a feu mainstreaned special education students 

(3) Teaching many mainstreamed special education students 

(4) Special education teacher 

(5) Other 



C CHANGES RATING 



S STARTS PROGRAM 
D GETS DIRECTIONS 



F PAGES FORWARD 
B PAGES BhCK 



On the f)ext page you will be asked to 
rate six item about mainstreaming on 
a scale of one through five* 



1 

strong! y 
Disagree 



Disagree 



3 

Neutral 



4 

Agree 



5 

Strong! y 
Agree 



!• In my opinion, mainstreaming is inappropriate 
when class size is medium to large. 

2. I believe that special education students have 
the ability to participate appropriately in 
regular classes* 

3* I think that mainstreaming benefits the teaching 
and learning processes of the regular classroom. 

4. I think that special education students should 
be mainstreamed only in basic skills classes. 

5. Regular teachers gonorally possess the expertise 
for effectively teaching mainstreamed students. 

6. The behavior of mainstreamed students too often 
sets a bad example for regular students. 



INITIAL SURVEY WITH 10 ITEMS 



Are you certified to teach snecial education? yes or no 
<please circle) 

What is the level of your current assignment? elementary or 
secondary or K-12 (please circle) 

Please rate the following items on a 1 to 5 scale. 



1. In my opinion, mai nstreami ng is inappropriate when class 
size is medium to large. 

2. I believe? that special education students have the 
ability to participate appropriately in regular classes. 

3. I think that mai nstreami ng benefits the teaching and 
learning processes of the regular classroom. 

4. I think that special education students should be 
mainstreamed only in basic skills classes. 

5. I Delieve that grading is not fair in classes where 
there are mainstreamed students. 

6. The presence of mainstreamed students will promote 
acceptance of differences on the part of regular 
students, 

7. Mainstreamed students are likely to develop academic 
skills more quickly in a special education class than 
i n a regu 1 ar cl ass. 

S. Regular teachers generally possess the expertise for 
effectively teaching mainstreamed students. 

9. The behavior of mainstreamed students too often sets a 
bad example for regular students. 

IOp Mai nf^trevicmi ng special education students promotes the 
special education studenfs social independence. 



1 

Strongi y 
Di sagree 



2 

Di sagree 



3 

Neutral 



4 

Agree 



5 

Strongi y 
Agree 



STATISTICAL ANALYSIS OF ATMS ITEMS 



EMS > . i ^ I .» ^ 

u 

53 cases are written to rne uncomaressea a'zrrive file. 



ine raw aara or rransformat ion oass is oroceeainu 



I**** Memory allows a total of 14733 Values, accurnuiarea across an variaoies. 
Th-^re also may be ud to 184£: Value Labels for eacn Variaoie. 
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SPSS/PC+ 



10/8/85 



Vc.lue Label 



lalid Cases 



53 









Val la 


Cum 


Va 4. ue F r eq uency 


Percent 


Percent 


Percenr 


1. 00 




3. 8 


3. 8 


3. 8 


00 


S0 


37. 7 


37. 7 


41.5 


3.00 


8 


15. 1 


IS. 1 


58. 8 


4. 00 




41. 5 


41. 5 


98. 1 


5. 00 


1 


1. y 


1. S 


100. 0 


TOTflL 


S3 




100. 0 




Missing Cases 


0 









-) 



Value Label 



faiid Cases 









Vaiia 


Cum 


Va 1 ue Freq uency 


Percent 


Percenr 


Percenr 


£. 00 


10 


18. S 


18.9 


18. 9 


3. 00 


11 


£0. 8 


£0.8 


39. 8 


^. 00 




49. 1 


49. 1 


68. 7 


U. 00 


6 


11. 3 


11.3 


100.0 


TOTAL 


53 


100. 0 


100. 0 




Missing Cases 


0 









Value La Del 



53 









Val la 


Cum 


Val ue FVea uency 


Percenr 


Percenr 


Percenr 


£. 00 


14 


£8. 4 


l=:8. 4 


c:6. 4 


3. 00 


l£ 


££. 6 


££. 8 


49. 1 


4.00 


£l 


39. 6 


33. fa 


88. 7 


S. 00 


6 


11. 3 


11.3 


100. 0 


TOTAL 


S3 


100. 0 


100. 0 




Missing Cases 


0 









SPSS/PC+ 



P3 



IW/A/Af:? 



) 



Val la Cum 

Valua LaDel Value Frequency Percent; Percent Percent; 



1. m 


3 


5,7 


5. 7 


5. 7 




s 


y. ^ 


y. 4 


15. 1 


3. 0W 


7 


13. t 


13. c: 


c:a. 


4. 00 


S4 


4d. 3 


45. ^ 




S. vs\d 


14 


ciS. 4 


c:6. 4 


100. I^t 



TOTML J>3 100.0 100.(^11 

Valid Cases S3 Missina Cases 0 



S 

Valid Cum 

Value Label Value Frequency Percent Percem: Percenv 



IZI. (3 


1 . 


1. 9 


1. 9 


1. 9 


1. iZiiZl 


1 


1.9 


1.9 


3. 8 


2. m 


7 


13. £ 


13. £ 


17. CJ 


3. iZiid 


IS 


£4. 5 


£4. 5 


41. 5 


4. i^iZi 


£7 


513. 9 


513. 9 


9£. 5 


s. m 


4 


7.5 


7. 5 


11313. iZi 



TOTttL 53 100. 0 100. 0 

aiid Cases 53 Missing Cases 0 



6 

Valia Cum 

Value Label Value Frequency Percent Percent Percent 



£. (313 


4 


7. 5 


7.5 


7. S 


3. 1313 


7 


13. £ 


13. £ 


£v>. B 


4. 130 




45.3 


45. 3 


6£. 13 


s. 1313 


l:^ 


34. 13 


34.0 


Il3i3. 0 


TOTAL 


53 


11313. 13 


11213.0 





alid Cases 53 Missing Cases 0 



^ge 32 SPSS/PC+ 10/ti/a5 
7 

Vaiia Lum 

Value Label Value Frequency Percent Percenr Percent 

3 5. 7 5. / 5. / 

11 £0. 8 £0. a c:ti. 4 

c:5 47. £ ^7. i=: * 73. b 

9 17.0 1/.0 9W. b 

5 9. 9. 4 100- 0 

— 




1. 00 

£. 00 

3. 00 

4. 00 

5. 00 



Value Label 



Valia Lum 
Value Freauency Percent Percent Percent 



ielid Cases 



53 





?/ 


17. is 


17.0 


17. 0 


a. m 




4-3. 1 


4^. I 


&6. 0 


3. 00 


a 


15. 1 


IS. 1 


81. 1 


4. m 


9 


17. la 


1/.0 


96. 1 


s. m 


1 


1. S 


1. 3 


100. 0 


TOTftL 


53 


100. 0 


100. 0 





Missing Cases 



0 



119 



Value Label 



IValid Cases 
[age 33 

Value Label 



53 









Valia 


Cum 


Value 


Frequency 


Percent 


•Percent 


Percent 


1. 00 


3 


5. 7 


5. 7 


5. 7 


a. m 


8 


13. 1 


15. 1 


S0. 6 


3. 00 


11 


E0. a 


£0.8 


41. 5 


4. 00 


£S 


47.£ 


47. S 


aa. 7 


5. 00 


6 


11. 7' 


11.3 


100. 


TOTf^L. 


53 


100. 0 


100. 




Missing Cases 0 










SPSS/PC+ 














Val la 


Cum 


Value 


Freauency 


Percent 


Percent 


Percent 


a. lata 


a 


0. a 


3. a 


3. a 


3. 00 


a 


15. 1 


15. 1 


18.9 


4.00 


30 


56. 6 


SB. fc> 


rs. ti 


5. 00 


13 


^4. 5 


24. 0 


J.00. 0 


TOTftL 


53 


100. 0 


100. 0 





ralid Cases 



53 
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Missing Cases 



0 



age 34 SPSS/PC+ 

this procedure was cornoleted at 16:55: lb 
age 35 SPSS/PC+ 

Cases Mean Srd Dev 



10/a/85 



i0/ti/a5 



Vari^blfe 

[ERIC 



S3 



3. 0000 
3. 5283 



1.0190 
'7 0 .9324 



LI2I 

noe 36 



53 
S3 
S3 
53 
S3 



4. 

3. W377 
•d. 3774 
3. 434W 
4. 0189 



8861 
9993 

7465 



SPSS/PC+ 
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*wr r^ei«u xonss 


T 1 
I 1 


Id 


13 


14 


£5 


X6 


1 11 


1 . mm 




. 3956* 


. I5l6 


. ll£l 


. 3833* 


■ l£ 


. 101c: 


1 . mid^ 


. 5139** . 3560* 


0£3S 


. 3lc:£ 


13 


. 3956* 


. 5139** 






. 0904 


. 1717 


1 -^'^ 


. ISlb 


. 3560* 


. 3307* 


1. 0000 


, 1905 


. £456 


1 IS 


. 1121 


0£35 




< Ciller 

. 1905 


1. 0000 


1 140 


16 


. 3833* 


.31ci£ 


. 1717 


. £456 


1140 


JL. 0000 


1 


. £077 


. 1846 


. 1591 


. 3513* 


. £693 


• 1496 


18 


0184 


• 371S* 


. IbSb 


. 361 1* 


. 043£ 


. 1381 


19 


.44S8** . 13S6 


. 3920* 


. 1483 


. 1076 




110 


. 1769 


.£617 


. 2^79 


. Hliil 


I38to 




' of cases: 


53 


1-tai led 


Sinnif : 


* - . 01 ** - 


. 001 




1 • "is orintea if a 


coefficient 


cannot oe 


coniDU'ced 






age 37 






SPSS/PC+ 






10/6/85 


prrelat ions: 


17 


18 


19 


110 








. S077 


0184 


.4428** .1769 








. 1846 


.3715* 


. 1326 


.S617 






' 13 


. 1591 


. 1656 


. 3920* 


. £479 






14 


. 3513* 


.3611* 


. 1483 


.£L£1 






IS 


. S693 


. 1343S 


. 1076 


-. 1386 






16 


. 1496 


. 1881 


. 1558 


. 3763* 






17 


1". 0000 


0706 


. 2011 


. 10£1 






18 


0706 


1. 0000 


. 0233 


.£9£6 






19 


. £011 


.0233 


1. 0000 


. £555 






110 


. 1021 


.e9£6 


. 2555 


1 . 0000 






of cases: 


53 


l""tai lea 


Sinnif: 


* - .01 /* - 


. 001 




. " is Drinted if a 


coefficient 


cannot De 


cofrtDUted 







lage 38 SPSS/PC+ 
Ijhis Drocedure was cornoietea at 16:58:31 

F**** Given W0fiKS5PftC£ allows for 005 Ceils with 1 Dimensions for Mti^NS 
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^age 39 

|ummarie»3 of 
3y levels of 

[ariaole 



II 

SCHLEV 
Value Label 



"or Entire Population 



ele 
kl£ 



yPSS/PC+ 



.^6 



Mean 

3. 0000 

£. 9£3i 
3. 3333 



hva Dev 

1. 0190 

1 . 0554 
.T;7 74 



10/8/85 



Cases 
3 



age 40 



SPSS/PC+ 



liZi/fcJ/85 



ummanes of IS 

y levels of SCHLEV 

ariaoie Value Label 

or Entire Population 



CHLEV 
HLEV 
SCHLEV 



ele 
kie 
sec 



Total Cases = 



53 



iYiean 

3. 5£83 

3. 346£ 
4. 3333 
3. faE50 



Sta Dev 

. ':^3£4 

. ^356 
-5774 
. y£37 



Cases 



£6 
3 

£:4 



age 41 



SPSS/PC+ 



i(o/B/as 



urnrnaries or 
By levels of SCHLEV 

ariaole Value Laoei 

or Entire Population 



CHLEV 
CHLEV 
CHLEV 



ele 
kiS 
sec 



Mean 
3. 3585 

3. 3333 
3. 45ti3 



Std Dev 
1. 012118 

. 5774 
1. W6£4 



Cases 
53 

3 
i=:4 



Total Cases = 



53 



ag& 42 

ammaries of 
y levels of 



14 

SCHLEV 



ariable Value Label 

or Entire Population 



|CHLEV 
IcHLEV 

iSCHLEV 



ele 
klS 
sec 



1 



Total Cases = 



53 



SPSS/PCh 



Mean 
3. 7736 
%ifm &tD«:)8 

3a ^^^^ 

3. 95b3 



Std Dev 
1. Ic:i35 
1. 1981 



lW/ti/83 



Cases 
53 

3 
£4 



!age 43 
urnmaries of 15 
my levels of SCHLEV 



ariable 



Value Laoei 



■or Entire Pooulation 



CHLEV 
CHLEV 
CMLEV 



ele 
klS 
sec 



Total Cases = 



S3 



Jurnmaries of 16 



SPSS/PC+ 



Mean 
3. 4340 

3. 19c:3 

4. Q}^^^ 
3, bc:50 



bta Dev 
1. W0S7 

. 9£37 



10/8/85 



Cases 

53 

26 
3 
c:4 



SPSS/PC+ 



97 



10/6/65 



tariaole Value uaoel 

[For Entire PoDuiation 



ICHL£V 
SCHLEV 
ICHLEV 



ele 

kva 

sec 



Total Cases = 



53 



Mean 

4. 11S4 
4, 00Wvii 



Sta Dev 
. B861 

1. id^dOa^ 
1. Wc:i5 



Cases 

3 
c:4 



lage 45 

[summaries of 17 
]y levels of SCHLEV 

[Variable Value uaDei 

lor Entire Population 



jCHLEV 
IcHLEV 
ICHLEV 



ele 
kl£ 
sec 



Total Cases = 
IPage 46 



53 



SPSS/PC+ 



nean 
3. 0377 

3. 13000 
3, 3730 



Sta Dev 
. 9993 
1 - WW£^' 

0.0 

.969b 



10/B/a5 



Cases 

53 

£6 
3 
£4 



[ummaries of 18 

?y levels of SCHLEV 

tariabie Value Label 

For Entire Popular .on 



CHLEV 
SCHLEV 
CHLEV 



ele 
kl£ 
sec 



Total Cases = 



53 



SPSS/PC+ 



Fiean 
£.3774 

3. 0000 

£. i£5<^ 



Sta bev 
1 . 0£33 
1 . 1^6 / W 

1. 000(^ 

. 9470 



IW/a/feti 



Uases 

53 

£b 
3 
c:4 



[age 47 

Summaries of J9 
y levels of SCHLEV 

Variable Value uaoei 

or Entire PoDulation 



SCHLEV 
icHLEV 
IcHLEV 



ele 
kl£ 
sec 



Total Cases = 



53 



SPSS/PC+ 



mean 
3. 4340 
3. 0769 

4. 0000 

3. 73WW 



Sta Dev 

1.0654 

1. 1635 
1. 0000 
. 84 7W 



10/tJ/85 



Cases 

53 

£6 
3 
£4 



page 48 

kimmaries of 
^y levels of 



110 

SCHLEV 



Value Laoel 
foV^B&mire Population 



Ya O ^ e 

ERIC. 



SPSS/PC+ 



iw/a/a3 



Mean btd Dev Cases 

98 ^-wiay .7463 



i5CHL.£v kic: 
SCHLtV sec 



bbb/ 
4. icl^ld 



Total Cases = 
Pace 49 



53 



10/8/83 



Summaries of IT 

By levels of SCHLEV 

Variadle Value LaDei 

For Entire Population 



SCHLEV 
SCHLEV 
SCHLEV 



ele 
klci 
sec 



fie an 

14c:3 
3. 0667 



Stc Dev 
. 34£8 
- 3443 
. 33t:;>l 



Cases 

53 

i=:4 



lotal Cases = 



53 
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SPSS/PC+ 




lW/S/85 


This procedure was completea 


at l6:59:l6 






This FftCiOR analysis reauires 13440 ( 13. 


IK) BYTES of memory. 
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10/ti/a5 






CTOR ANftLYSI 


S 




Analysis Numder 1 Listwise 


deletion of cases y^itn 


missmc va 


i ues 


Extraction 1 for ttnalys 




1, Pr mci pai-Componenrs ^^nalyBls 


iPC) 


Init ial Stat ist ics: 










Variable Communal ity 




Fact or E i genva 1 ue 


Pet of Var 


uum h*cx 


11 1.00000 




i c:. 94464 


iiS. 4 


c'zf. 4 


I£ 1.00000 




£ 1.48633 


14. 9 


44. 3 


13 1.00000 




3 1 . 30055 


1^'. 0 


57. *i 


14 1.00000 




4 .94819 


^. S 


66. 8 


15 1.00000 




5 .8145c: 


8. 1 


/4. 9 


16 ^.00000 




6 . 7£908 


7. 3 


8£. £ 


17 1.00(^0W 




7 .570/0 


D. ? 


87. 9 


18 1.00000 




8 .491 lb 


4. 9 


9£. 9 


19 1.00000 




9 .4E670 


4. 3 


97. 1 


110 1.00000 




10 . £8806 


£. 9 


100. 0 



PC Extracted 3 factors. 
Factor Matrix: 

FftCTOR 1 



12 
13 
14 
15 
16 
17 

110 



.56179 
. b540£ 
. 70£00 
.b£78l 
. 14375 
. 57380 
. 4£6£5 
. 4£9c:4 
• 53836 
. SS568 



FftCrOR ii: 

. 41676 
-. 33£3£ 
. 09734 
-. 037b9 
. 5684£ 
£lb7£ 
. 4/b£3 
55954 
.39707 

-•35170 



FfiCTU^^! : 

44E10 
• £1356 
-. 03485 
. 48c:58 
. 55154 

3£9£4 
. £8970 
• 363^4 

34910 

£7331 



Final Statistics: 



Var iaDle 


ComrnunajL ity 




r act or 


GiaenvalMe 


Pet or Var 


LLirn Met 


11 


. b847b 




Ji 


elm ^4484 




29. 


12 


. 58378 




c! 


1 . 48833 


14. 9 


4^. 3 


13 


. 50349 




3 


1. ^t^idSS 


i3. 


57. 3 


14 


. 62845 












15 
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i^pendix E 
Stages of Concern Screens 



On the next page you will be asked to 
rate six items about mainstreami ng on 
a scale of one through five. 
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1 

Strongly 
Disagree 



2 

Di sagree 



3 

Neutral 



4 

Agree 



5 

Strongly 
Agree 



1. In my opinion, mai ns traami ng is inappropriate 
when class size is medium to large. 

2. I believe that special education students have 
the ability to participate appropriately in 
regular classes. 

3. I think that mainstreaming benefits the teaching 
and learning processes of the regular classroom. 

4. I think that special education students should 
'be mainstreamed only in basic skills classes. 

5. Regular teachers generally possess the expertise 
for effectively teaching mainstreamed students. 

6. The behavior of mainstreamed students too often 
sets a bad example for regular students. 





CONCERNS QUESTIONNAIRE 



The purpose of this questionnaire is to determine 
the concerns of people who are or may be 
involved in mai nstreami ng. 

Since the term " mai nstreami ng" can be interpreted in 
different ways, we have included the following 
information. Please read this before completing the 
questionnaire. 



Not too long ago, students needing special 
education services were removed from the 
"mainstream" of regular education and placed in 
separate, self-contained special education classes 
or schools. These students were separated 
physically, socially, i nst ructionally and 
administratively from regular programs. 

In the 1960's people began to question this 
approach. It seemed that many special education 
students were being unfairly stigmatized and 
i solat ed from the general st udent populati on, 
and that these students were unnecessarily 
restricted in their access to the services and 
acti vi ties available to regular students. 
Further, and perhaps most suprisingly, the 

services provided by special education could not 
be shown to have educational benefits for a 

large portion of the special education 
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Mai nstr eami ng 
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population. Perhaps the students were -living down" 
to the expectations of special education. 

Thus, for more than a decade there has been 
a growing trend toward •*mainstreaming" special 
education students into regular programs. Ideally, 
mainstreami ng should have the following 
characteristics: 

1- To the maximimum possible extent, special 
education students are integrated into 
regular programs. 

This integration has the following aspects 
a. physical integration: To the maximimum 
extent, special education students are 
taught in physical proximity to regular 
education students. This means that some 



special education students who would once 
have been placed in special classes within 
regular schools. Some special education 
students who would once have been placed in 
in self-contained classes in regular school 
are not? placed in regular classes for some 
or most or even all of the school day. 

b. social integration: Physical integration 
permi ts soci al i nteracti ons to occur be- 
tween special education students and regular 
education students. This does not mean that 
mai nst reami ng requires teachers to plan 
structured social i nteracti ons between 
regular and special education students. 
Nor does it mean that all social interactions 
must be desirable and pleasant. It simply 
means that mai nst reami ng removes some of the 
school -ere a ted barriers that once contributed 
to an almost total social separation between 
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regular and special education students. 



c. instructional integration: To the maximum 
possible exlent, special education stu- 
dents receive the normal content and me- 
thods of instruction from the regular 
education program. Adaptations are made 
on an individual basis only to the degree 
made necessary by the student^ s special needs. 

d. administrative integration: Mainstreaming 
is not possible without administrative 
linkage between regular and special educa- 
tion programs. Special education students 
are the shared responsibility of regular 
and special education. 

2. A range of levels of special education are 
available. 



Some people mistakenly believe that main- 
streaming requires that all students be 
removed from special education and placed in 
regular education. The real trend is to develop 
a range of alternatives which include older 
approaches ( resource rooms, regular class 
placement vith special aides and supports, etc.). 

Anyone associated with today^s schools is aware 
that mainstreaming is already being implemented. 
Considerable progress has been made, but few (if any) 
schools or school systems have perfected the process. 
Strong evidence suggests that mainstreaming will be 
an enduring feature of American education. 
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Instructions for the Questionnaire 

Please respond to the followiK<{ items in terms 

of your present concerns, or how you feel about your 

involvement or potential involvefi;qnt with mai ns t reami ng. 

Items that represent concerns you do have should 

be marked on the scale according to the degree of 

intensity. 

7 « the statement is very true of you at this time. 

= the statement is somewhat true of you nt this time. 
1 = the statement is not at all true of you at this time. 
0 = the statement seems irrelevant to you. 

Remember to respond to each item in terms of your present 
concerns about your involvement or potential involvement in 
mai nst reami ng. 
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0 1 2 3 *l 5 6 

Irrelevant Not True Of Somewhat True Very True of 

nie now of me now me now 

1. I am concerned about my other students' attitudes 
toward having mainstreamed students in the 
classroom. 

2. I know of some other approaches besides main- 
streaming that would better meet the educational 
needs of all students. 

3. Because of having mainstreamed students in my 
classroom, I am concerned about not having 
enough time to organize myself each day. 

4. I would like to help other teachers to develop 
effective strategies for mai nst reami ng. 
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Irrelevant 



Not True Of 
me now 



Somewhat True 
of me now 



5. I have very limited knowledge about teaching 
mai nst reamed /students* 



I am concerned about changes in my professional 
status caused by teaching mainstreamed students. 



Very True of 
me now 



8* 



I am concerned about the conflict between 
:ny interests in teaching in general, and my 
responsibilities to teach mainstreamed students. 

I am concerned about revising the way I have 
been teaching students in my mainstreamed class- 
room. 
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Irrelevant 



Not True Of 
m6 now 



Somewhat True 
of me now 



9. I would like to develop working relationships 
with faculty in my school and other schools 
who are teaching mainstreamed students. 

10* I am concerned about how my regular students, are 
affected by having mainstreamed students in the 
classroom. 

11. I would like to know who will make decisions 
about the placement of mainstreamed students 
in my classroom. 

12. I would like to discuss approaches to teaching 
a mainstreamed class. 



Very True of 
me now 
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Irrelevant 



Not True Of 
me now 



Somewhat True 
of me now 



13* I would like to know what resources would be 
available to me for teaching mainstreameU 
students in my classroom. 

I'l- I am concerned about my inability to manage 

all that teaching mainstreamed students requires. 



15. I woul.i like to know how my teaching is supposed 
to change when I have mainstreamed students in 
my class. 

16.1 would like to familiarize others with the 
progi*ess of mai ns treami ng. 



Very True of 
me now 
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Not True Of 
me now 



Somewhat True 
of me now 



17. I am concerned about evaluating my effectiveness 
as a teacher of class containing some mainstreamed 
students. 

18, I would like to revise the instructional approach 
to mainstt*eami ng. 



19* I would like to modify our approach to main- 
streaming based on the experiences of my 
students. 

20. I would like to promote a positive attitude 
among my students about having mainstreamed 
students in class. 



Very Trrae of 
me now 
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Irrelevant Not True Of Somewhat True Very True of 

me now of me now me now 

21. I am concerned about time spent working with 
non-academic problems related to teaching 
mai nst reamed st udents« 

22. I would like to know what other changes in 
teaching mainstreamed students might be taking 
place in near future. 

23. I would like to coordinate my efforts with 
others to maximize the benefits of main- 
streaming. 

2^. I would like to have more information on expected 
time and energy commitments; required by the 
presence of mainatreamed students in my classroom. 
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Irrelevant Not True Of Somewhat True Very True of 

me now of me now me now 

25. I would like to know what other faculty are doing 
regarding mai nstreami ng. 

26. I would like to determine how to supplement^ 
enhance or replace the approaches we currently 
use for mainstreaming. 

27. I would like to use feedback from students 

to improve the implementation of mainstreaming. 

28. I am concerned about changes in my role due to 
the placement of mainstreamed students in my 
classroom. 
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Irrelevant Not True Of Somewhat True Very True of 

now of me now ' me now 

29. In my opinion, the coordination of tasks and 
people required by mainstreaming is taking 
too much of my time. 

30. I would like to know the rationale for main- 
streaming. 
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Abstract 



This study examined the statistical properties of the 

Stages of Concern About Innovation Questionnaire (SoC) as 

adapted for measuring regular teachers' concerns about the 
innovation malnstreaml ng. " This paper reports on the 

lnX<il S.°cfl'^^";'\°^ ^"^ describes an Item 

analysis based on data collected from 40 teachers during the 
summer of 1984. The results of this study are being used in 
the development of a computer program for dellverlno and 
scoring the SoC. ^ 
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The general focus of this project Is the development of 
a computer-based needs assessment system to select teacher 
training experiences for regular educators working with 
malnstreamed handicapped students. This system, termed SNAP 
(Systematic Needs Assessment Program), will use several 
types of data and data collection procedures which include 
both cognitive and affective outcomes. This study examines 
one affective measure. 

Affective factors are considered critical In the 
selection of teacher training experiences. To this end 
several methods of attitude assessment were considered. 
Observational work was considered to be too cumbersome to 
use In the system. On the other hand a unldlmenslonal 
attitude scale was considered to be too narrow In its focus. 
Also, an attitude scale dealing singly with the handicapped 
or malnstreaining distorted the efforts of the project In the 
sense that It focused attention on the malnstreamed student 
rather than on effectively teaching In the malnstreamed 
environment. For example, the "Attitude Toward Disabled 
Person Scale" developed by Yuker, Block, and Young (1970) 
consists of simple declarative statements about disabled 
persons to which the respondent answers true or false. 

The assessment method finally chosen was the SoC 
Questionnaire developed by Gene Hall and his colleagues at 
the University of Texas, Austin. This questionnaire deals 
with concerns rather than attitudes. The concept of concern 
is broader than that of attitude. Traditionally attitude is 
measured by locating an individual on a bipolar evaluative 
dimension (e.g.; gooCi - bad) relative to some object. In 
contrast, concern deals with the composite representation of 
feelings, preoccupation, thought, and consideration given to 
a particular issue or task (Hall, George & Rutherford, 
1979). 3y examining concerns rather than attitudes, a 
broader based entry point is achieved. Furthermore, the SoC 
as developed by Hall et al., contains seven subscales which 
form a logical developmental sequence of concerns. These 
subscales are: 

1. Awareness: Little concern about or involvement with 
the innovation is Indicated. 

2. Information: A general awareness of the innovation 
and Interest in learning more detail about it is 
indicated. The person seems to be unworried about 
himself/herself in relation to the innovation. She/he 
is Interested, in a selfless manner, in substantive 
aspects of the innovation such as its general 
characteristics, effects, and use requirements. 
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3. Personal: The Individual is uncertain about the 
demands of the Innovation, his/her adequacy to meet the 
demands, and bis/her role In the Innovation. 

4. Management: Attention is. focused on the processes 
and tasks of using the innovation and the best use of 
Information and resources. Issues related to 
efficiency, organizing, managing, scheduling, and time 
demands are utmost. 

5. Consequence: Attention focuses on the impact of the 
innovation on students in the individuals Immediate 
sphere of influence. The focus is on the relevance of 
the innovation for students, including performance and 
competencies, and changes needed to Increase outcomes. 

6-. Collaboration: The focus Is on exploration of more 
universal benefits from the innovation, including the 
possibility of major changes or replacement with a more 
powerful alternative. 

7. Refocusing: The focus Is on exploration of more 
universal benefits from the innovation, including the 
possibility of major changes' or replacement with a more 
powerful alternative. 

These subscales permit appropriate branching of users 
into subsequent activities such as training options. For 
example, someone expressing concerns about "Information" on 
mainstreaming would receive a different set of suggested 
activities than someone expressing concerns about 
collaboration" on mainstreaming. 

Pilot Study 

Introduction 

The SoC questionnaire developed by Hall et al., was not 
entirely appropriate in its original form for measuring 
concerns about mainstreaming. The major difference is that 
mainstreaming is mandated by law whereas "innovations" 
(original SoC scale) are not. Thus, questions such as: "I 
would like to discuss the possibility of using the 
innovation" were not appropriate. 

Question revision was undertaken by a panel of three 
researchers. Each researcher Independently revised the 35 
items to reflect the mandatory nature of mainstreaming. A 
group session was conducted to merge the revisions and 
rewrite the items. A sample revision is given below: 

Item: I would like to discuss the possibility of using 
the innovation. 



Revision: I would like to discuss approaches to 
teaching a mai nstreamed class. 

A comparison of the changes Is given In Appendix A. 
Appendix B contains -ihe final version of the SoC 
questionnaire. Including the Introduction and Instructions. 

Sampl e 

Participants in the pilot study were teachers and 
several administrators who were Involved In a professional 
workshop In Howard County and a class at the University of 
Maryland during the summer of 1984. Those involved In the 
workshop and class were asked to fill out the SoC 
questionnaire, and all agreed to do so. This resulted in a 
sample of convenience of 40. 

Procedure 



The participants filled out the seven page 
questionnaire during workshop or class time. Page 1 
contained descriptive questions regarding gender, age, and 
experience. The next two pages presented our definition of 
malnstreaming, followed by the 35 questions of the modified 
SoC. Participants took about 20 minutes to complete the 
questionnlare. 

Resul ts 

Descriptive Information about the sample is presented 
in Tables 1 through 5. The sample was slightly more than 
80i female. The females were more evenly distributed across 
grade level than the males, of whom 67% were from the high 
school level; 26Z of the females were from the elementary 
level and none at the elementary level were male. 86% of 
the males In the sample were regular teachers whereas 55Z of 
the females were regular tea-hers. 

More' than half of the sample had very little training 
In special education (see Table 4). Only 10% of the 40 
participants were certified or had a degree in special 
education. Table 5 reflects similar information and shows 
that a full 42. 5Z of the sample had little or no experience 
with the mainstreamed classroomm. 

Reliability statistics are presented in Tables 6 
through 8. Table 6 gives the Alpha coefficients for the 
overall scale consisting of all 35 items and each of the 
seven subscales. Note that each subscale consists of five 
items. The item analysis consists of item - total score 
correlations and these correlation coefficients are listed 
in Table 7. Finally, Table 8 contains the 1 ntercorrelati ons 
among the seven subscales. 
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The reliability data yield a clear pattern of results 
for this particular sample. Throughout Tables 6, 7, and 8 
the Awareness subscale shows up as relatively less reliable 
and less discriminating than the other six subscales. 

In Table 6 the Awareness subscale has. the lowest Alpha 
coefficient. Its coefficient is substantially less in 
magnitude than five of the other subscales and somewhat less 
than the Information subscale. Cronbach's Alpha is an 
internal consistency measure of reliability and thus a low 
coefficient is indicative of poor i ntercorrelati ons among 
the items of the subscale. Also, it is important to note 
that the overall reliability of the SoC was excellent (Alpha 

The results in Table 7 support the findings on the 
reliability coefficients. That is, five of the six items 
with the lowest item - total score correlation are from the 
Awareness subscale. Items 31 to 35 constitute the Awareness 
subscale ^nd all the correlations are low. In addition to 
these low correTati ons, a logical analysis of the items 
revealed that the double clause structure of item 34 
(Awareness subscale) created ambiguity. 

An overview of Table 8 shows that the Awareness 
subscale has generally low and negative correlations with 
the other subscales. While low correlation among subscales 
is considered a desirable property, these low correlations 
in conjunction with the results reported in Tables 6 and 7 
cast doubt on the usefulness of the Awareness subscale in 
thii research context. 

Indeed the very nature of the "innovation" of 
mainstreaming makes the Awareness subscale somewhat 
irrelevant. Mainstreaming is mandated by law and therefore 
teachers must be involved in it. Thus, it really is not 
reasonable to expect that a teacher would not be aware of 
mainstreaming. For these reasons it was decided to omit the 
Awareness subscale from further application within the 
context of this research project. 

In the interpretation of these reliability data there 
are two cautions. First, a sample of convenience was used 
and it is therefore inappropriate to generalize these 
results to a target population. Second, this reliability 
analysis has been conducted on a published scale which has 
already gone through a development phase in which the scale 
was created from a larger pool of items. To the extent that 
statistical procedures are normative, as they must be, the 
consequences of a "second level" reliability analysis are 
likely to show some items as poor. Nonetheless there are 
strong empirical (normative) and logical grounds for 
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discarding the Awareness subscale, but using the remaining 
scales In our application. 



Table 1 

Sex by level 



(Count 



Row % 
Col.J 


Primary 


Inter- 
mediate 


Middle- 
Junior H 


Senior 

-High 


K-12 


Male 




1.0 
16.7 
20.0 


1.0 
16.7 
11.1 


4.0 
66.7 
36.4 




Fsmale 


7,0 
25.9 
100.0 


4.0 
14.8 
80.0 


8.0 
29.6 
88.9 


7.0 
25.9 
63.6 


1.0 
3.7 
100.0 


Column Total 


7.0 
21.2 


5.0 
15.2 


9.0 
27.3 


u.o . 

33.3 


1.0 
3.0 



Row 
Total 

6.0 
18.2 



27.0 
81.8 



33.0 
100.0 



Number of missing observations = 7 
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Table 2 

i. ex_by Current Role 



Count 
Row % 
Col Z 



MaT 



Female 



Column 
Total 



Regular 
Teacher 



Admlnl strator 
or 

Supervl sor 



Other 



T 



85.7 


14.3 




26.1 


33.3 




17 


2 


12 


54.8 


6.5 


38.7 


73.9 


66.7 


100.0 


23 


3 


12 


60.5 


7.9 


31.6 


observati ons 


= 2 





Row 
Total 



7 

18.4 



31 
81.6 



38 
100.0 
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Table 3 

Current level by Current Role 



(Count 

Row % Inter- Middle- Senior Row 

Col. 2 Primary mediate Junior H High K-12 Total 



Regular Teacher 



Administrator or 
Supervisor 



Other 



4 

19.0 
57.1 



3 

37.5 
42.9 



Column 
■ Total 



7 

21.9 



3 

14. -3 
60.0 



2 

25.0 
40.0 



5 

15.6 



8 

38.1 
100.0 



8 

25.0 



Number of missing observations = 8 



6 

28.6 
54.5 



3 

100.0 
27.3 

2 

25.0 
18.2 



11 
34.4 



1 

12.5 
100.0 



1 

3.1 



21 
65.6 



3 

9.4 

8 

25.0 



32 
100.0 
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Table 4 

Tr&lnint) in Special Education 





Frequency 


Percent 


none 


14 


35.0 


one course or workshop 


1 1 

JL 1 


27.5 


two to four courses or 
workshops 


9 


22.5 


more than four courses or 
workshops 


2 


5.0 


certification or degree In 
special education 


4 


10.0 


TOTAL 


40 


100.0 
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Table 5 

Special Education Teaching Experience 



Frequency Percent 

very little or no 

experience 17 42,5 

regular classes with a few 
malnstreamed special 

education students 14 35,0 

teaching many malnstreamed 

special education students 7 17,5 
special education teacher 2 5,0 

TOTAL 40 100.0 
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Table 6 

Subscale Relabilitv Coefficients (Alpha) 



N Alpha 



Overall scale 


35 


.84 


Awareness subscale 


5 


.44 


Information subscale 


5 


.52 


Personal subscale 


5 


. r 


Management subscale 


5 


.70 


Consequences subscale 


5 


.65 


Collaboration subscale 


5 


.83 


Refocusing subscale 


5 


.77 
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Table 7 



Item Total 


Score 


Correlations 






I tern 


Total 


Score 


I tern Total 


Score 


1 




.42 


19 


.66** 


2 




.57** 


20 


.39 


3 




.40 


21 


.68** 


4 




.30 


22 


.58** 


5 




-.04 


23 


.37 


6 




.55** 


24 


.70** 


7 




.50* 


25 


.39 


8 




.65** 


26 


.41* 


9 




.51* 


27 


.48* 


10 




.46* 


28 


.70** 


11 




.57** 


29 


.53** 


12 




.32 


30 


.26 


13 




.37 


31 


.11 

• * * 


14 




.32 


32 


-.11 


15 




.51* 


33 


.15 


16 




.39 


34 


-.17 


17 




.52 


35 


-.09 


18 




.61** 







Minimum palrwise N of cases: = 32 
Significance: *-.01 **-.001 
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Table 8 

Subscale Intercorrelatlons 



Correlations 


Awar 


Info Pers Mana 


Cons 


Coll 


Ref 0 


Awareness 


1 


.0** 


-.13 


-.02 


.06 


.28 




- 25 


Information 


mm 


.13 


1.0** 


.51** 


.14 


.34 


.01 


.08 


Personal 




.15 


.51** 


1.0** 


.69** 


.48* 


.17 


.42* 


Management 




.06 


.14 


,69** 1 


. 0** 


.31 


,15 


.63** 


Consequences 




.28 


.34 


.48* 


.31 1 


.0** 


.35 


.57** 


Collaboration 




.24 


.01 


.07 


.25 


.35 1 


.0** 


.55** 


Refocusing 




.25 


.08 


.42* 


.63** 


.57** 


.55** 


1.0** 



Minimum palrwise N of cases = 34 
Significance: *-.01 **-.001 
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Appendix A TeA-hru caJL "l^jOot-f" ^2.0/ 

Revised SoC Statements 



Figure 1 
Revised SoC Statements 
(Original SoC Statesents are First) 



Item 

Number Statement 

Stage 0 Awareness 

3 I don't even know what the innovation is. 

I don't know anything about handicapped students being 
being taught in regular classes. 

I didn't know that special need children had been mixed into 
regular classes. 

I don't know anything about teaching handicapped students. 
12 I am not concerned about this innovation 

I am not concerned about handicapped students being taught 
in regular classes. 

The placement of handicapped children "into regular classes 
is something that does not concern me (that does not affect 
my work (teaching)). 

I'm not interested in teaching handicapped students. 
21 I am completely occupied with other things. 

I am completely occupied wtth other things than teaching 
handicapped students in regular classes. 
I am completely occupied with other things and am not 
concerned about the placanent of handicapped children in 
the regular classroom. 

I'm too busy already to be concerned with teaching handicapped 
students. 

23 Although I don't know about this innovation, I am concerned 
about things in the area. 

Although I don't know about teaching handicapped students in 
regular classes, I am concerned about the quality of education 
for handicapped students. 

Although I am not aware of (have not experienced) the 
placement of handicapped children in regular classrooms, 
I am concerned about these children. 
Although I don't know anything about teaching handicapped 
students, I am concerned about issues related to teaching 
the handicapped in regular classrooms, 
aa At this time, I am not interested in learning about this 
innovation. 

At this time, I am not interested in learning about teaching 

handicapped students in regular classes. 

At this time, I am not interested in learning about educating 

special needs children in the regular classroom. 

At this: time, I have no interest in learning about teaching 

handicapped students in my classroom. 
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stage 1 Informational 

6 I have very limited knowledge about the innovation 

I have very limited knowledge about "teaching handicapped 
students in regular classes. 

I have very limited knowledge of strategies, skills, innovations 
for dealing with special needs children in a regular class. 
O (about dealing with special needs children in a regular class.) 



Item 
Number 



Statement 



Stage 1 Informational (cont'd) 

6 (cont'd) I know very little about teaching handicapped students. 

14 I would like to discuss the possibility of using the innovation. 
I would like to learn more about teaching handicapped students 
in regular classes. 

Not appropriate 

I would be interested in discussing approaches to teaching 
handicapped students In my classroom. 

15 I would like to know what resources are available if we 
•decide to adopt this innovation. 

I would like to know what resources are available to support 
teaching handicapped students in regular classes. 
I would like to know what resources are available for helping 
special needs children in regular classes. Also resources 
available for teachers. 

I would like to know what resources would be available to me 

for teaching handicapped stjdents In my classroom. 
26 I would like to know what the use of the innovation will 

require in the immediate future. 

I would like to know what is really required to teach 

handicapped students in regular classes. 

I would like to know what additional resources may become 

available in the immediate future for educating handicapped 

children in the regular classroom. Terms: handicapped vs special needs. 

I would .like to know what changes in teaching handicapped 

students might be taking place in the near future. 
35 I would like to know the reasons for teaching handicapped 

students in regular classes. 

I would like to know how this innovation is better than 
what we have now. 

I would like to know how placing special needs children in 
a regular- class is better than attending to their needs in 
separate, self-contained classrooms. 

I would like to know why it is considered preferable to teach 
handicapped students in mainstreamed classrooms. 
X I would like to learn methods for teaching handicapped 
students in regular classes. 

I would like to know how to get information about teaching 
ha^ulicapped students in regular classes. 



Stage 2 Personal 

7 I would J ike to know the effect of reorganization on mu 
professional status. 

I am concerned about changes in my professional status 
caused by teaching handicapped students in regular classes. 
I would like to know what effect it will have on my role as 
a regular education teacher to have handicapped students in 
my class. 

I would like to know the effect of placing handicapped 
children in my class on my prefessional status. 
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Item 

Number Statenent 



Stage 2 Personal (cont^d) 

13 I would like to know who will rnake the decisions in the 
new system. 

I am concerned about who makes the decisions when handicapped 
students are taught in regular classes. 
I would like to know who will be making decisions about 
teaching handicapped students in my class. 
I would like to know who will make decisions about the 
placement of handicapped children in the regular classrooms. 
17 I would like to know how my teaching or administration is 
supposed to change. 

I am concerned about changes I am supposed to make in my 
teaching or administration because handicapped students 
are being taught in regular chasses. 

I would like to know how my teaching is supposed to change 
when I have handicapped students in my class. 
I. would like to know how my teaching or administration is 
supposed to change when there are special needs children in 
my classroom. 

28 I would Ifke to have more information on time and energy 

commitments required by this innovation. 

I am concerned about the time and, energy commitments 

required by teacfiing handicapped students in regular classes. 

I would like to have inore information on expected- time and 

energy commitments required by the presence of spectal 

needs children in my classroom. 
33 I would Itke to know bow my role will change when I am 

using the tnnoyation. . . 

I am concerned afiout changes in my role when handicapped 

students are taught in regular classes. 

I would Itke to know about the changes in my role when teachtng 
classes that contain handicapped children. Hove away from future tense. 
I would like to know how my role will cliange when I have 
handicapped students in my classroom. 

Stage 3 Management 

4 I am concerned about not having enough time to organize 
myself each day. 

Because of mainstreaming, I am concerned about not having 
enough time to organize myself each day. Orient question to mainstreamir 
I am concerned about not having enough time to organize 
myself each day, because of m^instreaming. 
8 I am concerned about conflict between my interests and my 
responsibilities. 
Difficult to apply. 

I am concerned about the conflict between my interests 
in teaching in general, and my responsibilities to teadh 
handicapped children. 
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Item 

Number Statement 



Stage 3 Management (cont'd) 

16 I am concerned about my inability to manage all the innovation 
requires. 

I am concerned about my inability to manage all that teaching 
handicapped students in regular classes requires. 
I am concerned about my inability to manage all that 
mainstreaming requires. 

I am concerned about my inability to manage all that 
teaching handicapped students in my regular class requires. 
25 I am concerned about time spent with non-academic problems 
related to this innovation. 

I am concerned about time spent working with non-academic 
problCTJS related to teaching handicapped students in regular 
classes. 

I am concerned about time spent working with non-academic 
problans related to mainstreaming. Good for branching, say, 
to discipline issues. 

I am concerned about time spent working on non-instructi.onal 
problems related to teaching handicapped students (paperwork, 
discipline). 

34 Coordination of tasks and people is taking too much of my time. 
In my opinion, the coordination of tasks and people required 
by mainstreaming is taking too much of my time. 
Stein "in my opinion"; term mainstreaming fits better. 
Coordination of tasks and planning with people is taking too 
much of my time. 

Stage 4 Consequences 

1 I am concerned, about students* attitudes ■ toward this innovation. 
I am concerned about students' attitudes toward teaching 
handicapped students in regular classes. 
I am concerned about other students' attitudes toward 
having handicapped students in the class. 
I am concerned about students' attitudes toward handicapped 
children in the regular classroom. Again question of ^"handicapped." 
11 I am concerned about how the innovation affects students. 
I am concerned about how students are affected by teaching 
handicapped students in rjgular classes. 

I am concerned about how mainstreaming affects: a) regular students 

b) special needs studen 

I am concerned about how including handicapped 

students in my class will affect both them and the regular 

students. 

19 I am concerned about evaluating my impact on students. 

I am concerned about evaluating my impact on the special 
needs children in my class. 

I am concerned about evaluating my effectiveness as a 
teacher of a Claris containing some handicapped students. 
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Item 

Number Statement 



Stage 4 Consequences (cont'd) 

24 I would like to excite my students about their part in 
this approach. 

I would like to excite (involve) aJX ny students about 
their part in mainstreaming. Are students aware of this change? 
I would like to promote a positive attitude among my students 
toward including handicapped students in the class and in 
class activities. 

32 I would like to use feedback from students to change the program. 
I would like to use feedback from students to guide my 
efforts as a teacher of the handicapped students in my class. 
I would like to use feedback from students to improve mainstreaming. 

Stage 5 Collaboration 

5 I would like to help other faculty in their use of the innov-tion. 
I would like to help other faculty in teaching handicapped 
students tn regular classes, 

I would Ifke to help other teachers in their teaching of 
ma instr earned classes. 

I would like to help other teachers to develop strategies 
for teaching handicapped students in their classes. 
ICL I would like to develop working relationships with both our 
faculty and outside faculty using this innovation; 
I would Ifke to develop worlcing relationships with both our 
faculty and outside faculty in teaching handicapped stuclents 
in regular'classes. 

I would like to work more closely with teachers in our school 
and other schools who are teaching in mainstreamed classrooms. 
Include "Not applicable" box. 

I would like to develop working relationships with faculty in 
my school and other schools who are working with handicapped 
students in their classes. 
18 I would like to familiarize other departments or persons with 
the progress of this new approach. 

I would' like to familiarize other departments or persons with 
the progress of teaching handicapped students in regular classes. 
I would like to familiarize other teachers with the benefits 
(and problems) of having handicapped students in their classes. 
I would like to familiarize other people (e.g« parents) 
with the progress of mainstreaming. 
27 I would like to coordinate my effort with others to maximize 
the innovation's effects. 

I would like to coordinate my effort with others to maximize 
the effect of teaching, handicapped students in regular classes. 
I would like to coordinate my efforts with other teachers to 
maximize the benefits of teaching handicapped students in 
regular classes. 

I would like to coordinate my efforts with others to maximize 
benefits of 'mainstreaming. 



Item 
Number 



Statement 



Stage 5 Collaboration (cont'd) 

29 I would like to know what other faculty are doing in this area. 
I would like to know what other faculty are doing related 
to teaching handicapped students in regular classes. 
I would like to know what other faculty are doing in 
mainstreaming, 

I would like to know what other faculty members are doing 
in this area. 

Stage 6 Refocusing 

2 I now know of some other approaches that might work better. 
I now know of other approaches that might work better in 
teaching handicapped students in regular classes, 
I now know of some strategies for teaching handicapped 
students that are more effective than others for teaching 
handicapped students in regular classrooms, 
I know of some other approaches besides mainstreaming that 
would better meed the educational needs of handicapped children 
children, (reforming means "innovation has occured^" 

9 I am concerned about revising my use of the innovation. 
I am concerned about revising my approaches to teaching 
handicapped students in regular classes. 

I am concerned about :revising Difficult to apply. 

Direction of concern. 

I am concerned about revising the way I have been teaching 
the handicapped students in my classroom. 
20 I would like to revise the innovation's instructional 
approach. 

I would like to revise the approach to teaching handicapped 
students in regular classes. 

I have some new instructional approaches for dealing with 
handicapped children in the regular classroom. Broadness 
of notion of "handicapped." 

I would like to revise the instructional approach to teaching 
handicapped -students in regular classrooms. 
22 I would like to modify our use of the innovation based on 
the experience of our students. 

I woul like to modify our teaching of handicapped students 
in regular classes based on the experiences of our students. 
I would like to modify our approach to mainstreaming based 
on the experiences of my students. Are mainstreaming 
approaches defined from school to school?) 
I would like to modify our approach to teaching handicapped 
students based on the experiences of our students. 
31 I would like to determine how to supplement, enhance, or 
replace the innovation. 

I would like to determine how to supplement or enhance our approach 

to teaching handicapped students in regular classes. 

I would like to determine how to supplement, enhance or replace 

mainstreaming as it is implemented in my school. 

I would like to determine how to supplement, enhance, or replace the 

approaches we currently use for teaching handicapped students 

in. regular classes, J 
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Figure 2 

Coaplete Pilot Study Questionnaire 
Directions: Please fill In the descriptive Information below. 

1. Sex: (1) Male (2) Female 

2. Age: (1) 20-25 (2) 26-30 (3) 31-35 (4) 36-40 

(5) 41-45 (6) 46-50 (7) 51-55 (8) 56 or above 



3a) Current role: 

(1) Regular Teacher 

(2) Special Education /eacher 

._ (3) Administrator or Supervisor 
(4) Other 



(p'',iase specify) 



3b) Current level: 
^ (1) Preschool 

(2) Primary 

(3) Intermediate 

(4) Middle-Ounlcr high 

(5) Senior high 

(6) K-12 



4, Years of experience In current role: 

5. Total years of experience In education" 



6. What training have you had In special education? 



(1) Kone 

(2) One course or workshop 

(3) Two to four courses or workshops 

(4) More than four courses or workshops 

(5) Certification or degree In special education 



7. Experience teaching special education. 
1. Very little or no experience 

2. Regular classes with a few malnstreamed special education students 

3. Teaching many malnstreamed special education students 

4. Special education teacher 
5. Other 



(please specify) 

8. Check those adjectives which apply to the experience Indicated above. 

successful pleasant 

unsuccessful unpleasant 
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CONCERKS QUESTIOHHAIRE 

The purpose of this questionnaire Is to determine what 
people who ere or may be Involved in mai nstrjami ng are concerned 
about at various times. Since the term "mal nstreami ng" can be 
interpreted in different ways, we have Included the following 
information. Please read this before completing the 
questionnaire. 



Halnstreamin^ 

Not too long ago, students needing special education 
services wera removed from the "mainstream" of regular education 
and placed in separate, self-contained special education classes 
or schools. These students were largely separdted physically, 
socially, 1 nstructi onally and administratively fronr regular 
programs. 

In the 1960*s, people began to question this approach. It 
seemed that many special education students were being unfairly 
stigmatized and Isolated from the general student population, and 
that these students were unnecessarily restricted in their access 
to the services and activities available to regular students. 
Further, and perhaps most suprisingly, the services provided by 
special education could not be shown to have educational benefits 
for a large portion of the special education pcoulation. Perhaps 
the students were "living down" to the expectations of special 
education. 

Thas, for more than a decade there has been a growing trend 
toward roainstreaming" special education students into regular 

Jr^fr^f^' ^^^^ ^^^^^ reflected in a federal law (P.L. 

94-142}. Ideally, malnstreaming should have the following 
characteristics; 

^' l£ Ihl SiiLlHl"!H£ Possib 1 e extent^ special educatio n 
studen ts are - fntegrat ed fhto regul ar p rogra ms. ThTs 
integration has the foTlowTng aspects: 

a. physical integration: To the maxi mi mum possi bl e 
extent, special education students are taught in 
physical proximity to regular education students. 
This means that some special education students who 
would once have been placed in self-contained special 
schools ape now placed in special clas-i < within 
regular schools. Some special education students who 
would once have bee.n placed in self-contained classes 
in regular schools are now placed in regular classes 
for some or most or even all of the school day. 

b. social integration: Physical integration permits 
social interactions to occur between special education 
students and regular education students. This does 
not mean that malnstreaming requires toachers to plan 
structured social interactions bitween regular and 
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special eaucation students. Nop does it mean that all 
social interactions must be desirable and pleasant. 
It simply means that mal nstreaming removes some of the 
school-created barriers that once contributed to an 
almost total social separation between regular and 
special education students. 

c. Instructional Integration: To the maximum possible 
extent, special education students receive the normal 
content and methods of Instruction from the regular 
education program. Adaptations are made on an 
Individual basis only to the degree made necessary by 
the student's special needs. 

d. administrative Integration: Ma1 nstreaml ng is not 
possible without administrative linkage between 
regular and special education programs. Special 
education students are the shared responsibility of 
regular and special education. 

2' J 111151 of levels of Sfiecla^ education are a vailable . 
Some people mi stakenlybeTleve that malnstrAming ' 
requires that all students be removed from special 
education and placed In regular education. The real 
trend Is to develop a range of alternatives which Include 
older approaches (self-contained special classes, special 
schools, residential facilities, etc.) and newer 
approaches (resource rooms, regular class placement with 
special aides and supports, etCo). 

Anyone associated with today's schools is aware that 
mainstreaming Is already being Implemented. Considerable 
progress has been made, but few (if any) schools or school 
systems have perfected the process. Strong evidence suggests 
that mainstreaming will be an enduring feature of American 
education. 
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Instruction s for the Questlonnai re 

Please respond to the following items In terms of your 
Pr^s^"t concerns, or how you feel about your 1 nvol vemen tor 
potential Involvement with mal nstrearal ng. Items that represent 
concerns you do have should be marked on the scale according to 

°^ Jl^^-lV^y- ^^^^^ ^^^^ "e*" completely Irrelevant 
should be marked 0 , 

For example: 

This statement is v«ry true of me at this time. 0123456(j) 

This statement Is somewhat true of me now. 0123 (T^ 567 

This statement is not at all true of me at thiu time. 0(Tl 234567 

This statement seems Irrelevant to me. 1 2 3 4 5 6 7 

Remember to respond to each item In terms of your present 
concerns about your involvement or potential involvement in 
mai nstreami ng. 



THANK YOU FOR TAKING TIME TO COMPLETE THIS SURVEY. 
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0 1 2 3 4 5 6 7 

Irrelevant Mot true Somewhat true of me now Very true of me now 

of me now 

1. I am concerned about my other students' attitudes 01234567 
toward having malnstreamed students In the 

classroom. 

2. I know of some other approaches besides main- 01234567 
streaming that would better meet the educational 

needs of all students. 

3. I didn't. know malnstreaming was taking place In 01234567 
Ry school. 

4. Because of having malnstreamed students In my 01234567 
classroom, I am concerned about not having 

enough tine to organize nyself each day. 

5. I would like to help other teachers to develop 01234567 
effective strategies for malnstreaming. 

6. I have very limited knowledge about teaching 01234567 
malnstreamed students. 

7. Ian concerned about changes In oy professional 01234567 
status caused by teaching malnstreamed students. 

8. I an concerned about the conflict between 01234567 
ny Interests In teaching In general, and ny 

responsibilities to teach malnstreamed students. 

9. I an concerned about revising the way I have 01234567 
been teaching students 1<i my malnstreamed class- 
room. 

10. I would like to develop working relationships 01234567 
with faculty in my school and other schools 

who are teaching malnstreamed students. 

11. I am concerned about how cy regular students are 01234567 
affected by having malnstreamed students in the 

classroom. 

12. I am not concerned about teaching malnstreamed 01234567 
students in ny classroom. 

13. I would like to know who will make decisions 01234 5 67 
about the placement of malnstreamed students 

In ny classroom. 

14. I would like to discuss approaches to teaching 01234567 
a malnstreamed class. 
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Irrelevant 



Not true 
of roe noM 



3 4 5 

Somewhat true of me now 



6 7 
Very true of me now 



15. I would like to know what resources would be 
available to me for teaching oalnstreacKd 
students In ny classroom. 

16. I am concerned about i&y Inability to manage 

all that teaching inalnstreamed students requires. 

.17. I would like to know how my teaching Is supposed 
to change when I have mains trearoed students In 
my class. 

18. I would like to familiarize others with the 
progress of roalnstreamlngc 

19. I am concerned about evaluating rny effectiveness 
as a teacher of class containing some malnstreamed 
students. 



01234567 



0 
0 

0 
0 



1 
1 

1 
1 



2 
2 

2 
2 



3 
3 

3 
3 



5 
5 

5 
5 



6 
6 

6 
6 



7 
7 

7 
7 



20. I would like to revise the instructional approach 0123456 7 
to nalnstreamlng. 



21. I an completely occupied with other things. 

22. I would like to modlly our approach to main- 
streaming based on the experiences of 
students. 

23. Although I don't know anything about main- 
'streaming, I an concerned about Issues of 
Special Education. 

24. I would 11.**e to promote a positive attitude 
among my students about having malnstreamed 
students in class. 

25. I am concerned about time spent working with 
non-academic ?rcblems related to teaching 
mainstreaR3d studunts. 

26. I would like to know what other changes in 
teaching malnstreamed students might be taking 
place in the near future. 

27. I would like to coordinate my efforts with 
others to maximize the benefits of main- 
streaming. 



0 
0 



1 
1 



2 
2 



3 
3 



4 
4 



5 
5 



6 
6 



7 
7 



01234567 



01234557 



01234567 



0 1 2 3 4 5 6 



01234567 



28. I would like to have more information on expected 01234567 
time and energy commitments required by the 
presence of nainstreamed students in my classroom. 
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0 12 
Irrelevant Mot true 



3 4 5 

Somewhat true of me now 



6 7 
Very true of me now 



29. 1 would like to know what other faculty are doing 
regarding mainstreaming. 

30. At this time, I am not Interested In learning 
about teaching mainstreamed students. 

31. I would like to determine how to supplement, 
enhance or replace the approaches we currently 
use for mainstreaming. 

32. I would like to use feedback from my students 
to improve the implementation of mainstreaming. 

33. I am concerned about changes in my role due to 
the placement of mainstreamed students in my 
classroom. 

34. In ny opinion, the coordination of tasks and 
people required by mainstreaming is taking 
too much of 1^ time. 

35. I would like to know the rational for min- 
streaming. 



01234567 



01234567 



01234567 



01234567 



0 1 2 3 4 5 6 7 
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Abstract 



Visual analysis of individual profiles may overlook important 
deff^fSrL°f inferences that are unimportant. The procedure 

Sff^J provides an empirical basis for choosing a simple 

Drof n!^ n !:^9orithm for identifying important features of individual 
proriies ii.e.^ outliers). 

hi^st ?S<n?fiJ?*^°''? data analysis technique was used to determine the 
a^t^f^Sf ir statistical algorithm for identifying outliers on an 
dl«i^?«^2o ^^f-'^f^" ""^^^ ^^"^ subscales. Four algorithms based on 
sSbscalei Irnln^"^? "'^"f ^° identify outliers among the six 

subscales. Profiles from individuals in two samples (n=40; n=35) were 

n^o?ie|-.«.f ^^'J^*'"^ ^i'^ increasing narrower decision baids were 
plotted against the number of outliers produced by each algorithm. The 
tSrl^^w^r*? two algorithms to be superior for identifying out? ers in 
the individual profiles. This exploratory technique is useful for 

^^'^^ ^= insufficient data points for statistical 
tests and when visual analysis may yield inconsistent results. 



ERIC 



.144 



Exploratory Data Analysis 
for 

Descriptive Profile Development 

INTRODUCTION 

This paper reports the results of an exploratory data analysis 
technique used to determine the best descriptive statistical algorithm 
for profiles from an attitude questionnaire with six subscales (i.e.. 
Stages of Concern Questionnaire; Hall, 1979). Four algorithms based on 
descriptive statistics were developed to identify "outliers" among these 
6 subscales. In order to select the most successful algorithm (in terms 
of criteria described below), the exploratory analysis procedure plotted 
the percent of observed outliers as a function of the four algorithms. 

"Outliers" and patterns of outliers form an important starting 
place for interpreting group and individual profiles. Outliers may be 
identified by a variety of methods from simple visual inspection to 
complex statistical approaches described in Kratochwill (1] and 
[23 . Identifying outliers thus requires either a judgment bas-ad on 
visual inspection of their relative positions or the application of 
quantitative criteria which provides normative information on the 
location of subscale means. In some cases visual inspection is 
sufficient because differences are large, in other cases "visual 
inspection is the only viable option due to an inadequate number of data 
points upon which to base the statistics. However, the visual 
inspection method does not give the practioner external criteria to sort 
cut which subscale means are "close" and which are "outliers" from the 
others . 
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Unfortunately, from a traditional statistical view point, when 
subscale means are only based on a few data points which are from the 
same subject (i.e., 5 dependent data points in this study) statistical 
tests of significance are inadequate and inappropriate. Nevertheless, 5 
data points does yield the range of descriptive indices such as the 
mean, standard deviation and standard error. 

The strategy presented in this paper was to plot the results of 
several different descriptive statistical algorithms and interpret this 
function in terms of what an analysis of profiles generally would lead 
to: profiles with varying numbers of outliers. Thus, the criteria for 
an algorithm to be successful is that it must lead to some outliers but 
not identify all the subscale means as outliers. In other words, a 
profile with no outliers is not informative, nor is a profile that is 
all outliers very informative. 

Specifically, the statistical algorithm reported in this paper 
presents simple descriptive statistical criteria which will allow the 
praetioner to determine the relative "closeness" of the subscale means 
in the profiles. ?he major advantage of this algorithm over visual 
inspection is the ability of the algorithm to apply statistics (i.e., 
mean, standard deviation ?nd standard error of the mean) to assist in 
the judgment of relative" "closeness" of profile means. 
THE SCALE 

The scale used in this study is the Stages of Concern About the 
Innovation Questionnaire (SoC) which was developed by Gene Hall and his 
associates to measure dimensions of concern about an innovation 13]. 
For example, when a new technology, such as microcomputer operated video 
disks, is introduced into selected classrooms, the SoC can be used to 
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study the affective impact of this technology on teachers. Teachers may 
register mostly personal concerns about the technology or they may seek 
to collaborate with others for more effective applications of the 
technology. 

The "innovation" in the context of this study is mainstreaming. 
While mainstreaming cannot be considered an innovation in the usual 
sense because it is legally mandated, it does represent sn identifiable 
change in the classroom. As such it makes sense to measure attitudes 
and concerns about it. 

The SoC subscales used in this study were two through seven. 
Although items were reworded slightly to reflect concerns about 
mainstreaming, a mandated innovation, in general the wording was 
consistent v/ith the original items. The items associated with each 
subscale are randomly placed throughout the questionnaire. The revised 
SoC questionnaire is included in an appendix to this report. 
DESCRIPTIVE PROFILE ANALYSIS 

This study is part of a project which deals with the application of 
microcomputer based technology and data based management to the 
development of training suggestions for regular teachers in the 
mainstreamed classroom. . One entry point into this system will be 
thfough the SoC questionnaire.' The SoC was selected because it provided' 
a profile of teacher concerns relative to mainstreaming without reducing 
concerns to a single dimension as many attitude scales do. From the SoC 
profiles and other sources of data the microcomputer based decision 
rules will channel through the training options and select ones 
considered most appropriate for a particular teacher. 
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The SoC questionnaire is one of the main entry points into the training 
options data base. Its successful application depends on: a) subscales 
being logically related to training options; and b) subscale variation 
which can generate a variety of different profiles. Without variation 
among the srbscale means, differential decisions would not be possible. 

SoC profiles may be examined from two general perspectives: a) 
normative perspective; and b) criterion perspective. The research 
reported by Hall, George and Rutherford 13] takes a normative approach 
to profile interpretation. They report a raw score-percentile 
conversion chart which is based on the responses of 646 individuals who 
completed the questionnaire in the spring of 1975. A stratified sample 
was taken from elementary and higher education institutions to rate the 
innovation of "teaming" or "modules". The authors argue that experience 
has shown that the percentiles are representative of other innovations. 
Their approach is normative in that the interpretation of group and 
individual profiles is accomplished by converting the raw subcale scores 
into percentiles from the conversion chart. 

On the other hand one can argue that the examination of a single 
person's profile may be a criterion referenced task. In this case one 
would compare the six raw score means of an individual respondent rather 
than transform their raw scores into normed percentiles. This kind of 
analysis would bt criterion referenced because the meaning of the 
profile would not r.^ly on the profiles of other individuals, which would 
be necessary to get the percentile scores. It is this latter 
interpretation which is sought for a descriptive profile analysis. To 
this end the normative percentiles reported by Hall et al [3] are not 
used; instead the analysis is developed from raw scores and means. 
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ALGORITHM DEVELOPMENT 

There are two major ways that profiles can be analyzed. The first 
simply involves visual inspection. One examines a profile and rank 
orders the subscale means from highest to lowest. Once the rank ordering 
is complete, an interpretation of the pattern is made. This is the 
method used by the developers of the SoC. For example. Hall and his 
associates suggest that the highest subscale score for each individual 
be circled, thereby drawing attention to that subscale. Hall 
categorizes different profiles as single peak and multiple peak "user" 
and "nonuser" profiles. This latter classification ("nonuser") was not 
of interest here because there are no nonusers of the mainstreaming 
concept. Unfortunately, Hall does not give criteria for distinguishing 
between single and multiple peaks; such criteria would be important 
because all the subscale peaks usually ave different values. 

The second approach to profile analysis applies criteria in order 
to make distinctions between the various subscale means. The criteria 
provide the researcher with an empirically based indication of which 
scales are considerably different from the others. Since the means were 
only based on 5 data points, traditional statistical significance 
testing was inappropriate. Instead, a method was sought which would 
identify outliers only when it seemed visually or logically that 
outliers were present. The success of the algorithm depended on its 
ability to sort profiles into profiles with outliers and without 
outliers. Algorithms were selected so that they generated increasingly 
narrow intervals around the overall mean and the six subscale means. A 
percent of outliers (i.e., "at least one outlier per subject" or 
"multiple outliers per subject") was calculated for each algorithm. 



ERIC 



6 

.M9 



Pour algorithms were tested. The first built an interval around 
the grand mean based on the standard deviation of the individual's 
responses to the 30 items and a series of intervals around the subscale 
means based on the standard deviation of the individual':" responses to 
the 5 items of that subscale (ISD/ISD) . The second algorithm was the 
same as the first except that the standard errors of the respective 
subscale means was used rather than the standard deviations (ISD/ISE). 
The third algorithm used one half a standard deviation for the grand 
mean interval and one standard error of the subscale means for the 
subscale intervals (.5SD/1SE). The last algorithm gave the narrowest 
intervals and was ons half of a standard deviation for the grand mean 
and one half of a standard error for the six subscale means (.5SD/.5SE). 
?IETHOD 

Data were collected from two separate samples of teachers. Sample 
II consisted of 40 teachers from education classes during a summer 
session at the. University of Maryland. This group received the SoC 
questionnaire in paper and pencil form. Sample tl2 consisted of 34 
teachers and 1 supervisor who were participating in sommer workshops »«r 
developing materials in their county Staff Development Center. This 
group completed the SoC inventory via microcomputer. 

The first sample was used" to test the four algorithms' and the 
ser-ond sample was used to replicate tb« results from the first sample. 
Both groups were samples of convenience which limits the 
generalizability of the results. 
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RESULTS 

For sample one the first algorithm (ISD/ISD), which gave the widest 
intervals, resulted in no single or multiple outliers. For the second 
algorithm (ISD/ISE) 12.5% of the 40 subjects had at least one outlier 
and 0% had multiple outliers. Algorithm three (.5SD/1SE) showed 82.5% 
of the subjects with at least one outlier and 45% with multiple 
outliers. The results for algorithm four (.5SD/.5SE) were similar to 
algorithm three with 85% of the subjects showing at least one outlier 
and 47.5% of the subjects with multiple outliers. 

For sample two, the first algorithm (ISD/ISD), also resulted in no 
single or multiple outliers. The second algorith (ISD/ISE) resulted in 
5.7% of the 35 subjects showing at least one outlier; 0% had multiple 
outliers. Algorithm three (.5SD/1SE) showed 62.9% with at least one 
outlier and 40% with multiple outliers. The results for algorithm four 
were similar to three, with 68.5% showing at least one outlier and 37% 
showing multiple outliers. 

Figure One plots the "at least one outlier" and "multiple outlier" 
lines for each of the four algorithms for samples 1 and 2. 



INSERT FIGURE ONE HERE 



DISCUSSION 

Visual analysis of individual profiles may overlook important 
differences or yield differences that are unimportant. The procedure 
described here provides an empirical basis for choosing a simple 
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descriptive algorithm which meets certain requirements. Specifically 
the selected algorithm should identify profiles that have some 
outliers. If all the individual profiles are seen to have outliers or 
none of the profiles are seen to have outliers, then the analysis may be 
said to grossly over identify or underidentify differences within the 
sample. While it is conceivable that all individuals in a sample could 
either show flat or variable profiles, it is not likely for a "normal" 
sample. Thus the suc-:essful algorithm will identify some individuals az 
having flat profiles and others as having variable profiles. 

Figure One clearly shows that the first two algorithms yielded flat 
profilfjs for all individuals in the sample. Algorithm 3 showed a sharp 
rise in the number of profiles that were not flat (i.e., no outliers) 
and algorithm 4 showed a leveling in the number of variable profiles 
identified relative to algorithm 3. 

This step function result indicates that algorithms 1 and 2 are 
unsuitable for descriptive profile analysis. That is, these two 
algorithms do not yield results that would be expected from a sample 
with "normal" differences among its members; simply put, there are not 
enough outliers identified. Thus, algorithms 1 and 2 are rejected. 

However both algorithms 3 and 4 were successful in that they 
identified *40% and 47.5% of the profiles as having multiple outlie^rs, 
and between 62.9% and 85% of the profiles as having at least one 
outlier. Furthermore, the algorithm by % outlier function steps up 
dramatically at algorithm 3 and levels off somewhat as it moves over to 
algorithm 4. Thus, it appears that algorithms 3 and 4 would be equally 
suitable for identifying outliers in the kind of descriptive profile 
analysis discussed here. 
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Finally, in order to illustrate the usefulness of having an 
algorithm assist in the description of individual profiles, algorithm 3 
was applied to two selected individuals from sample n. Their profiles 
are presented in Figure 2 below. What does a visual analysis of these 
profiles indicate? 



INSERT FIGURE 2 HERE 



Visual inspection might indicate that individuals 1 and 2 each had one 
low outlier (3.0 and 3.6 respectively). However, when algorithm 3 is 
applied to these profiles, individual 1 has no outliers and the second 
Individual has two outliers (i.e., 5.8 and 3.6). What is not visually 
represented in these graphs as the standard deviations. Clearly, the 
responses given by the first individual are more variable than those of 
the second. 

From this example, visual inspection does not probe into the 
variability and equally important not all methods of incorporating the 
standard deviation would be successful. Figure Three shows the same two 
individual profiles with the actual data points included (five data 
points did not always show up because some of the values overlapped). 
From Figure Three it is clear which profile is less variable and 
therefore more li)tely to yield outliers. 



INSERT FIGURE 3 HERE 
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By looking across the profiles of a sample of individuals, a method 
has been presented to select an algorithm (or procedure) for identifying 
outliers on individual profiles. This exploratory data analysis 
technique used statistics in a descriptive way to locate outliers on 
each profile. A particular set of descriptive statistics (i.e, 
.5SD/1SE) was selected over other choices by plotting the outcomes of 
different descriptive statistical algorithms against outcomes (% 
outliers), and chosing the algorithm that resulted in a set of outcomes 
(% at least one outlier; % multiple outliers) expected of a sample with 
"normal" variability. Finally the results were replicated with a second 
saraple. 
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Learning Goals Field Test 

The Learning Goals Instrument was tested with Howard County 
teachers during the summer 1985. The following description Identifies 
the sample and explains the data collection procedures. 

Sample . The Howard County Director of Staff Development provided 
SNAP personnel access to Howard County teachers at two locations— a high 
school, where curriculum workshop participants were grades K-12, and the 
Staff Development Center, where teachers of all grade levels met to 
develop Instructional materials and to participate In workshops. A total 
of 35 educators (34 teachers and 1 supervisor) completed the Learning 
Goals Inventory. Nineteen teachers were secondary, and fifteen were 
elementary. Secondary teachers were In the teaching areas of science, 
social studies, and physical education. 

Procedures . Teachers met with a SNAP researcher on a one-to-one 
basis. I he researcher ]ave the teacher a copy of the Learning Goals 
Inventory, a set of 25 items In a Likert scale (l=not useful; 
5=essent1al) format. The researcher told the teacher to rate each Item 
according to the degree of usefulness to the teacher In the teacher's 
present teaching assignment. (The supervisor was asked to rate each Item 
for usefulness In her supervisory position.) 

At the cohipletlon of the Inventory, the researcher examined the 
form for the number of "5" ratings. If the teacher had rated more that 5 
Items with a "5", the researcher asked the teacher to mark his or her 5 
most essential Items with an asterisk. The explanation to the teacher 
was that when the Inventory Is on the computer, teachers will be asked 
to follow a similar procedure for Identifying no more than 5 essential 
learning goals. 

Descriptive Analysis of Data Collected 

Twenty five learning goals were presented to 34 teachers and 1 
supervisor as part of a SNAP pilot stu<|y conducted In the summer of 
1985. Analyses descriptive of the Interrelationships between the 25 
learning goals were based on exploratory factor analysis. A simpler 
approach based on learning goal Intercorrelatlons was rejected as not 
feasible because of the number of Intercorrelatlons that would need to 
be Inspected (I.e., [25 x 24]/2 = 300). 

Due to wording not consistent with the rating task, learning goal 
25 was discarded. This decision was corroborated by an Initial factor 
analysis which Included learning goal 25 and showed It to be the only 
variable to load on factor 5. The second factor analysis (principal 
components) yielded 5 factors accounting for 75.7 percent of the 
variance. The percentage of variance for each factor were: 

Factor Percent of Variance 
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1 
2 
3 
4 
5 



44.5 
12.3 
8.8 
5.6 
4.5 



It was decided to run a third and final factor analysis restricting 
the solution to only three factors. The results were: 

Factor Percent of Variance 



1 
2 
3 



43.9 
11.6 
9.3 



An oblique rotation was applied in order to achieve maximum 
differentiation between the learning goals. 

An arbitrary factor structure coefficient (correlation between 
the variable and the factor) of .6 was established as the criterion 
for whether or not a variable was associated with a factor. The 
results are given below. 

FACTOR ONE: Learning Goals - 1 through 10 and 21 through 24 
FACTOR TWO: Learning Goals - 11 through 15, and 8, 23 
FACTOR THREE: Learning Goals - 16 through 18 

Learning goals 19 and 20 did not substantially correlate with any of 
the three factors. 



Examination of the content of the 24 learning goals suggests the 
following interpretation. Factor One learning goals are more general 
In nature and deal with both approaches to instruction and overall 
aspects of motivation (e.g., "How to deal with student's behavioral or 
motivational problems). Two exceptions to this Interpretation of 
Factor One would be learning goals 7 and 8 - the use of classroom aids 
and gaining access to Instructional materials. These two Items are 
more specific than the others associated with Factor One. 

Factor Two deals specifically with "How to do It" problems. For 
example, learning goal 11 concerns "how to select and adapt materials 
to teach students who have trouble learning". Note also that learning 
goal 8 which Is associated with Factor One, also Is associated with 
Factor Two. Learning goal 8 is specific: "How to gain access ot 
Instructional materials, equipment, etc. for malnstreamed students". 

Factor Three deals with record keeping and assessment. The three 
learning goals for Factor Three ask about grading, tracking and 
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determining skill level. 

The two learning goals not associated with any factor appear to 
be redundant with the Items In Factor Three. Learning goal 19 Is 
nearly a verbatim repeat of 18, and learning goal 20 deals with 
student records and Is redundant with 16 and 17. 

Age by learning goal correlations were computed. Age was 
statistically correlated with learning goals 11 and 14. In both 
instances the correlations were negative. These learning goals dealt 
with specific concerns (Factor Two): 1) selecting and adapting 
materials for students with learning troubles; and 2) providing 
Instruction for slower students without disrupting Instruction for 
other students. TJie negative correlation indicates that older (and 
presumably more experienced) teachers already know how to ao these 
things and therefore these learning goals are not useful. 

The factor analysis and correlational results are presented as 
descriptive information. Their interpretation must be Informed by 
logical analysis and further empirical results. Nonetheless theca 
results, particularly the factor analyses, provide a way of organizing 
the learning goals into a more general framework suggested by the 
three factors. 
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Cipher in the Snow-Record tt2 
AFFECTMODE=p <A> 
DSPEC= ed <M> Id <M> 
GOALS = d <H> 
SOC = pr <H> cq <M> 
TLEV = el <H> jr <M> sh <N) 

i nstruc act i v i ty r3 
AFFECTMODE = <A> 
ALTPROB = si <M> 
LSPEC = lai 

GOALS = k <M> ! (K) e <H> i <M> o <H> r (H.- w <M) 
SOC = pr <H> cl <H> rf <M> 
SITREQ = hse] 



Exceptional Students in the Ma i ris,tream-ch . 1 andch. 15 
Teacher Preparation intro r5 

GOALS = b<M/ c <M> d <H> 

SOC = in <^0] 



Exceptional Students in the Minstream - ch.2 
The M'n tally Retarded mr r6 

DSPEC - mr <M) 

GOALS = d <H> c <M> 

SOC = in <A> 

TLEV = el <H> jh <M> 

Exceptional Students in the Mai nstream-ch . 3 
The Learning Disabled Id r7 

DSPEC = Id <M> 

GOALS = d <H> 

see = in <A> 

TAREA = la <H> mi <H> ss <H> sc i (H> h <H) ] 

Exceptional Students in the Mainstream - c-i. 5 
Th9 Or thoped/Chron 111 id r8 

DSPEC = oi <M> ci <M> 

GOALS = d <H> 

SOC = i.T <A>] 

Exceptional Studentss in the Mainstream - ch.<S 
The Hearing Impaired r9 

DSPEC = h <M> 

GOALS = d <H> 

SOC = in <A>] 

Exceptional Students in the Mainstream - ch. 7 
The Visually Impaired plO 

DSPEC = V <h) 

GOALS = d <H> 

SOC = in <A>] 



Exceptional Students in the Mainstream - ch. 9 
The Speech Impaired rll 
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DSPEC = spl <M) 
GOALS = d <H) 
SOC = in <A)] 

Exceptioanal Students in the Mainstream - ch. 13 
The EfriotionaHy Troubled rl2 

DSPEC = ed <M) 

GOALS = d <H) 

SOC = in <A)3 

lEP'S rl3 

GOALS = a <M> 
SOC = <A) ] 

Cry Sorrow, Cry Hope rl3 
DSPEC ^ mr <M) 
GOALS = d <H) 
SOC = pr <M) 
TLEV = el <M)] 

I'll Dance at Your Wedding ri9 
AFFECTMODE = p <A) 
DSPEC = h <M) 
GOALS = D <M) 
SOC = pr <H) 
TLEV' = el <M) jh <M)] 

Hewitt'e Just Di-f-ferent r20 
AFFECTMODE= p <A) 
DSPEC = mr <M) 
GOALS = m <M) d <M) 
SOOC pr <M) cq <H) 
TLEM = &; <H) jh <M)] 

Non-instructional Activity with Handicapped Child r21 
AFFECTMODE = p (A) 
DSPEC = cp <M) 
GOALS = d <H) 
SOC = PR <H)] 

Finding a ^oice and Like Other People r22 
AFFECTMODE = p <H) 
GOALS = d <H) 
SOC = pr <H)] 

"Including Me" and Bibliography r23 
AFFECTMODE = p <H> 
GOALS = d <H> 
SOC = in <M> pr <M> 

Case Study r24 

AFFECTMODE = a <A> 
LSPEC = lai 

GOALS = d <M> e <H> i <M> 1 <M> 
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SOC = in <M> pr <M> cq <M> r-f <M> 
SITREQ = hhc] 



"Reversals r25 

AFFECTMODE = p <A> 
DSPEC = Id <M> 
GOALS = d <H> e <H> 
SOC = pr <H> 

Videotaping with Peer Conferencing r26 
ALTPROB = et <M> si <M> at <M> 
QUESPROB = '■ <M> si <M> rd <M> 
LSPEC = lai 

GOALS = j <H> 1 <H> rr. <H> n <H> u <M> k- <M> w <,^> i <H> =■ 

<M> 

SOC = mn <H^ cq <H> cl <H> 
SITREQ = evo] 

Videotaping a Mai nstreairied Student's Social 
Interact! ons-YourCl assr 27 

GOALS = cq <H> r-f <M> 

SITREQ evo] 

Visit to a Mainstreamed Class 
AFFECTMODE = a <A> 
LSPEC Lai 

GOALS = j <M> 1 <H> 1 <M> m<M> r. <M> u <M> v <M> w <M> 
SOC = mn <H> cq <M> cl <M> r-f <M> 
SITREQ = SAP] 

"A Show o-f hands-Say it in Sign Language" r2? 
AFFECTMODE = a <M> 
DSPEC = h <M> 
GOALS = m <H> 
SOC= cq <H> 
TLEV = el <H> sh <N>] 

"Don't Drown in the Mainstream" r31 
LSPEC = 1ms 

GOALS = a <M> b <M> c <M> -f <M> g <M> h <M> i <M> j <M> 1 
<M> m <M> n <M> x <M> 
SOC = in <M> mn <H> 

TAREA = la <H> ma <H> ss <K> sc i <H>3 

"Inroducing PL 94-142" and "Complying with PL 94-142"r32 
GOALS = a <M> b <H> c <H> 
SOC = in <H>3 

Pro-f ess i onal Pairing r33 
AFFECTMODE = a <A> 
GOALS = J <M> 

SOC = in <M> pr <M> mn <M> cq <M> cl <M> r-f <M> 
SITREQ = h-fa] 



Meet with Handicapped Adults r34 
AFFECTMODE = a <A> 

GOALS = d <H> s <H> m <M> u <M) g <M> w <M> 
SOC = in <H> pr <H> r-f <M>3 

"v^i?* "Kevin" r35 

AFFECTMODE = p <A> 
DSPEC = V <M> 
GOALS = d <H> 
SOC = pr <H> 

TLEV = EL <M> JH <M> SH <N>] 

"B] i nd Sunday" r36 
AFFECTMODE = p <A> 
DSPEC = V <M> 
GOALS = d <H> 
SOC = pr <H> 
TLEV = sh <H> el <N>] 

"Teaching the Learning Disabled Adolescents Strat''oi*'= ^nrj 
;-.-..y Methods" r40 

DSPEC = Id <M> 
.-■ -.. LSPEC = Isg 

GOALS 1 <H> m <H> n <H> d <H> e <H> 

SOC = mn <H> 

TLEU = jh <M> sh <H> el <N>] 

Trainee as Resarcher r41 
LSPEC = lai 

GOALS = k <M> 1 <H> m <H> n <H> o <M> w <H> 
SOC = cq <H> cl <H> rf <H> 
PREREQ - rcr] 



"Across the Silence Barrier" r42 
DSPEC = h <M> 
GOALS = <H> 
SOC = in <L> ] 

"Organizing and Managing the Elementary School Cl a-^sroom" 
r44 

ALTPROB = et <M> si <M> at <M> 
QUESPROB = or <M> si <M> rd <M> 
DIRPROB = low 
LSPEC = 1cm 

GOALS =1 <H> m <H> n <H> u <M> v <M> w <M> 
SOC = mn <H> 
TLEKf = el <A> 

TAREA = <H> ma <H> ss <H> sc i <H>3 

Mai nstreami ng Exceptional Children r45 
GOALS - a <H> b <H> c <H> d <H> 
SOC = in <H>] 

Mainstreaming the Hearing Impaired Child r46 
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DSPEC = h <M> 
GOALS = d <H> 
SOC = in <H>3 



Mai nstreami ng the Visually Impaired Child r47 
DSPEC = V <M> 
GOALS = d <H> 
SOC = in <H> ] 



Adapting Instruction & Modi-fying Leison Plans r43 
ALTPROB = et <M> si <M> 
QUESPROB - si <M> 
LSPEC = Isg 
GOALS = k <H> 1 <H> 
see = mn <H> cq <M> 
TLEV = el <H> jh <M> 

TAREA = la <H> ma <H> ss <H> sc i <H>] 

Alexander Graham Bell Associates -for the Df'a-f, In--. r^9 
AFFECTMCDE = a <H> 
DSPEC = h <M> 
GOALS = d <H> 
SOC = mn <M> r-f <H>] 

Having a Colleague observe a Mainstreamed Students's Soc i 
Interactions r50 

GOALS = m <H> J <H> i <H> v <M> u <M> 

SOC = cq <H> r-f <M> 

SITREQ = hcc] 

In-service Workshop -for Teachers of Mainstreamed Hearing 
Impaired Students 

AFFECTMODE = a <A> 

DSPEC = h <M> 

LSPEC = lai 

GOALS = c <H> d <H> e <H> i <H> j <H> m <M> n <H> 
SITREQ = Shi ] 

American Foundation -for the Blind r52 
DSPEC = V <M> LSPEC = lai 

GOALS = c <H> e <H> i <H> k <H> 1 <H> m <H> n <H> 
SOC = r-f <H>] 

American Printing House -for the Blind r53 
GOALS = b <H> -f <H> 
SOC = MN <M> r-f <M> 
SITREQ = cvi ] 



American Speech and Hearing Association r54 
"SPEC = spl 
LSPEC = lai 
GOALS = 1 <H> 
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SOC = rf <K> ■ 
SITREQ CSn 

Matter i«1 Eyaluation r55 
ALTPROB = et <H> si <H> 
QUESPROB = si <M> 
GOALS = q <K> 
SOC = mn <H>] 

Association -for Children with Learning Disa 
LSPEC = lai 
GOALS =1 <H> b <H> 
SOC = in <M> r-f <H> 
SITREQ = cid] 

National Interpreter Training Consortium r5 
DSPEC = h <M> 
GOALS = d <M> j <M> 
SOC = in <M> r-f <H> 

National Paraplegia Foundation r58' 
DSPEC = oi <M> 
GOALS = d<H> 
SOC = r-f <H> 

Recording -for the Blind, Inc. r59 
GOALS = h <H> 
SOC = mn <M> r-f <H> 

Un i ted Cerebral Pal sy Assoc i at i on , Inc. r<SO 
DSPEC = cp <M> 
GOALS = d <H> e <H> i <H> 
SOC = r-f <H>] 

Spina Bi-fida Association o-f America r.51 
DSPEC = sb <M> 
GOALS = d <H> i <H> 
SOC = in <M> ,-f <H>] 

Cystic Fibrosis Foundation r62 
DSPEC = c-f <M> 
GOALS = d <H> m <M> 
SOC = in <M> r-f <H> 
TLEV = sh <H>] 

Epilepsy Foundation o-f America r63 
DSPEC = ep <M> 
GOAL? = d <H> 
SOC = in <M> r-f <H> 

Council -for Exceptional Children r<S4 
GOALS = <H> g<H> h <H> i <H> o <H> 
SGC in <M> mn <M> cq <M> r-f <M, ] 
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Epilepsy School Alert and Epilepsy and the School Age Child 
r65 

DSPEC = ep <M> 
LSPEC = 1ms 

GOALS = d <H> 1 <H> m <H> n <H> 
SOC - in <M> mn <M> cq <M>] 

The Handicapped Experience it Bibliography r66 
AFFECTMODE = p <M> 
SOC = pr <M>] 

Explodinq the Myth r67 
DSPEC ~ mr <M> 
GOALS = d <H> 
SOC = in <H>] 

Whatever It Takes r68 
FFECTMODE = p <H>- 
LSPEC = 1ms 

GOALS =1 <M> m <M> n <M> o <M> q <M> r <M> t <M> 
SOC = pr <H> 
TLEV = sh <H> 
TAREA = ve. <A>3 

Teaching Educatable Mentally Retarded Children r-69 
DSPEC = mr <M> 
LSPEC = 1ms 

GOALS = d <H> e <H> 1 <H> m <H> n <H> 
SOC = in <M> mn <H>3 

David r70 

AFFECTMODE = p <A> 
DSPEC = mr <M> 
GOALS = d <H> e <H> 
SOC pr <H>] 

/- 

Adolescence and Learning Disabilities r71 
DSPEC = Id <M> 
GOALS = d <H> e <H> 
SOC = cq <H> 
TLEU = el <N> sh <K> 
TAREA = ve <H>3 

A Di-f-ferent Approach r72 
AFFECTMODE = p <A> 
GOALS = d <H> 
SOC = pr <H> 

TLBJ = sh <H> Jh <H> el <M>] 

Evaluatinq Students in the Mainstream r73 
ALTPROB = si <H> 
QUESPROB = si <M> 

GOALS = o <H> p <H> q <H> r <H> t <H> 
SOC = mn <H> cq <M> 
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TLEV' = e] <H> jh <M) 

TARE:A = la <H> ma <H> ss <H> sc i <H>] 

^®''*^'"<^*=''"'"®cting Learning Materials r75 
ALTPROB = et <H> si <H> 
GOALS = k <H> 
SOC = mn <H> 
TLEU = el <A> 

TAREA = la <H> ma <H> ss <H> sc i <H>] 

The Teacher and the Child with Spina Bifida & An Educator 
ouide to Spina Bifida r77 
DSPEC = sb <M> 
GOALS = d <H> e <H> x <M> 
SOC = in <H>] 

'v^isit a Mainstreamed Class which has an Aia* r7S 
ALTPROB = et <H> 
GOALS = 9 <H> 

SOC = mn <H> cq <M> cl <H> ri <M> 
TLEV = EL <A>] 

Modifications in Academic Classses r79 
ALTPROB = et <M> si <M> 
GOALS = k <H> p <H> 
SOC mn <H> cq <M> 
TLEV = jh <H> sh <H> 

TAREA = la <H> ma <H> ss <H> =c ' <H>] 

Peer Tutoring rSO 

ALTPROB = et <H> si <H> 
LSPEC = Isg 

GOALS =1 <H> m <H> n <H> 
SOC = mn <H> cq <H> 
TLEV = el <H> jn <H> 

TAREA = la <H> ma <H> ss <H> sc i <H>] 

Learning Charac ter i st i ess r82 
ALTPROB = et <M> si <M> 
LSPEC = Isg 

GOALS = e <H> 1 <H> o <H> 
SOC = in <H> mn <H>] 

Remembering r83 

ALTPROB = et <H> si <H> 
DIRPRCB = low 
LSPEC = 1 sg 
GOALS = 1 <H> 
30C = MN <H> 
TLEV = jh <H> sh <H>] 

Textbook Usage r84 

ALTPROB = et <M> si <M> 
DIRPROB = low 
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LSPEC = Isg 

GOALS = 1 <H> 

SOC = mr. <H> 

TLE^ = Jh <H> sh <H> 

TAREA = la <H> ma <H) ss <H> see <H>] 

<«^isual Aids r35 

ALTPROB = et <M> si <M> 

DIRPROB = LGW 

LSPEC = LSG 

GOALS = L <H> 

SOC = MN <H> 

TLBJ = Jh <H> sh <H> 

TAREA = la <H> ma <H> ss <H> sc i <H>] 

Skimming" & Scanning" rQ6 
ALTPROB = et <M> si <M> 
DIRPROB = low 
LSPEC = Isg 
GOALS = 1 <H> 
SOC = mn <H> 
TLEU = jh <H> sh <H> 

TAREA = la <H> ma <H> ss <H> sc i <H>3 

Test Sk i n s r37 

ALTPROB = et <M> si <M> 

DIRPROB = low 

LSPEC = Isg 

GOALS = 1 <H> 

SOC = mn <H> 

TLEV = jh <K> sh <H> 

TAREA = la <H> ma <H> ss <H> sc i <H>] 

The Request Procedure r38 
ALTPROB = et <H> si <H> 
QUESPROB = si <M> 
DIRPROB = low 
LSPEC = 1 sr 

GOALS =1 <H> m <H> n <H> 

SOC = mn <H> 

TLE^ = jh <H> el <M> 

TAREA = la <H> ss <H> sc i <H>j 

Inducii-ig Use of a Text Lookback Strategy 
Unsuccessful Readers r39 

ALTPROB = et <H> si <H> 

DIRPROB = low 

LSPEC = Isr 

GOALS = 1 <H> 

SOC = mn <H> 

TLEV = el <H> jh <H> sh <M> 
TAREA = la <H> ss <H> sc i <H>] 

Direct Instruction of Summer i zat i on Skill 
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ALTPROB = et <H> si <H> 

DIRPROB = low 

LSPEC = Isr <M> 1 so <M> 

GOALS = 1 <H> 

SOC = mn <H> 

TLEU = Jh <M> sh <H> 

TAREA = la <H> ss <H> sc i <H>] 

Becoming a Strategic Reader r91 
ALTPROB = At <H> si <H> 
LSPEC = Isr 
GOALS = 1 <H> 
SOC = in <M> mn <H> 
TAREA -•= la <H> ss <H) sc i <H>] 

Communicating with Parents of Exceptional Childrer. 
GOALS = X <A> 

SOC in <M> pr <M> mn <M> cq <M> cl <M> r-f <M>] 

Tape Recording Educational Materials -for Secondary 
Handicapped Students r*»5 

ALTPROB = et <H> si <H> 

GOALS = k <H> 

SOC = mn <H> 

TLEV=jh <H> sh <H>] 

When you have a Visually Handicapped Child in your 
Classroom: Suggestions -for Teachers r94 
DSPEC = V <M> 

GOALS = b <H> c <H> d <M> i <M> 1 <M> 
SOC in <H> mn <H>] 

Videotaping -for Se 1 f -Observat i on r95 
ALTPROB = et <M> si '<M> at <M> 
QUESPROB = or <M> si <M> r-d <M> 
LSPEC = lai 

GOALS = i <H> 1 <H> m <H> n <H> u <H> y <H> w <H> 
SOC = mn <H> cq <H> 
SITREQ = evo] 



Managing Special Groups in CLassaroom Management -for 
Elementary Teachers r96 

ALTPROB= et <H> si <H> 

DIRPROB = low 

LSPEC = 1cm 

GOALS =1 <H> m <H> n <H> w <H> 
SOC = mn <A> 
TLEV = el <A> 

TAREA = la <H> ma <H> ss <H> sc i <H>] 

View Videotape o-f "Expert" Mainstresjrr Teacher r97 
ALTPROB = et <H> si <H> 
QUESPROB or <M> si <H> pd <M> 
LSPEC = lai 
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GOALS = j <M> i <M> 1 <H> m <H> n <H> u <M> v <M> w <MV 
SOC = mn <H> cq <H> c1 <M> r-f <M> 
SITREQ = het] 

Observation o-f Special Education Teachers Working with one 
or more Students -from Teacher's Class r9S 

ALTPROB = et <H> si <H> 

QUESPROB = or <M> si <M> 

LSPEC = lai 

GOALS = a ^H> b<H> c <H> i <M> 1 <H> 
SOC = mn <H> cq <M> ci <M> 
SITREQ = sse] 

Meeting with Special Education Teachers in August or 
September to learn about Teach i no New Mainstreamed StLd^^nts 
r99 

ALTPROB = et <H> si <H. 
LSPEC = lai 

GOALS = -f <H> g <H> h <H> i <H> j <H> K <M.> 1 <H> m <H> " 

<H> u <M> 
SOC = in <M> mn <H> cq <M> cl <H> 
SITREQ = stm] 

Managing Special Groups in Classroom Management -for 
Secondary Teachers rlOO 

ALTPROB - et <H> si <H> 

DIRPROB = low 

LSPEC = 1cm 

GOALS =1 <H> m <H> n <H> w <H> 
SOC = mn <A> 
TLEV = el <A. 

TAREA = la <H> ma <H> ss <H> sc i <H>] 

Interview Parents o-f Handicapped Child rlOl 
AFFECTMODE = a <A> 
GOALS = d <H> e <H> x <M> u <M> 
SOC = pr <H> 
SITREQ = hhp] 

Meet with Special Education Teachers be-fore starting New 
Unit o-f content rl02 

ALTPROB = et <H> si <H> 

LSPEC = Isg 

GOALS = -f <H> g <H> h <H> i <H> j <H> K <M> 1 <H> m <H) n 

<H> 

SOC = mn <H> cq <M> cl <H> 
SITREQ = hse3 

Using Cla-vsroom Dialogues and Guided Practice to Teach 
Comprehension Strategies 4103 

ALTPROB = et <H> si <H> 

QUESPROB = or <M> si <M> 

DIRPROB = low 

LSPEC = Isr 
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GOALS =1 <H> m <H> n <H> 
SOC = mn <H> cq <H> r-f <H> 
TLEV = el <H> jh <M> 
TAREA = la <H> sc i <H> ss <H>3 

Mind Mapping -for Creative Probltm Solving rl04 
LSPEC = Isg <M> 1 cm <M> 

GOALS = c <H> 1 <H> m <M> n <M> o <M> p <M> q <m> r <M> 

<M> 

SOC = mn <H> cq <M> cl <H> 
SITREQ = scp] 

Reviewing a Cumulative Folder rl05 
GOALS = i <H> t <M> 
SOC = mn <H>] 

Attending to Students' Needs rl06 
GOALS = c <H> w <M> 
SOC = cq <H>] 

E-f-fective Teaching Behaviors -for Mai nstreami ng rl07 
ALTPROB = et <M> at <M> 
QUESPROB = si <M> 
LSPEC = 1cm 
GOALS =1 <M> n <M> 
SOC = <H>] 

The Case o-f Phillip Becker rl08 
AFFECTMODE = et <M> 
LSPEC = 1ms 

GOALS = c <H> 1 <H> n <H> w <M> 
SOC = pr <M>] 

Things to Learn about Mai nstreami ng rl09 
ALTPROB = et <M> 
LSPEC = 1ms 

GOALS = c <H> 1 <H> n <H> w <M> 
SOC =mn <H> ] 

FDR's cover up; The extent o-f his Handicap rllO 
AFFECTMODE = p <A> 
GOALS = d <M> 
SOC = pr <M>] 

Explicit Teaching o-f Reading Comprehension rill 
DIRPROB = low 
LSPEC = Isr 
GOALS -1 <H> 
SOC = mn <H> 

TLEV = jh <H> sh <H> el <M> 
TAREA = la <H>] 

Helping Readers understand Di-f-ferent Types o-f Questions rll 
QUESPROB = si <H> 



LSPEC = Isr 

GOALS = 1 <H> 

SOC = MN <H> 

TLEV = el <H> jh <H> 

TAREA = la <H> ss <H> sc i <H>] 

Mai nstreami ng: How Teachers Can Make It Work rll3 
LSPEC = 1ms 

GOALS c <M> k <M> 1 <H> m <M> n <M> 

SOC =mn <H> cq <H> 

TAREA = la <H> ss <H> sc i <H>] 

Strategies -for Teaching Students Who Have Trouble Leai-riinc, 
rlM 

LSPEC = Isg 

GOALS =1 <H> p <H> n <H> 
SOC = mn <H>] 

Grading rll5 

GOALS = p <H> 
SOC = mn <H> 

TLEU = jh <H> sh <H> el <H>] 

Modifying Classroom Exams -for Secondary LD Students rll6 
LSPEC = Isg 

GOALS =1 <M>- p <H> q <H> 

SOC = mn <H> 

TLEU = jh <H> sh <H>] 

Reducing Stress o-f Students in Conflict rll7 
GOALS = w <H> 
SOC = cq <H> mn <M>] 

Dictation: An additional students Team Learning Technique 
rll3 

LSPEC = 1 sg 

GOALS =1 <M> m <M> n <M> w <M> 
SOC = mn <H> cq <M> 
TLEU = el <M> jh <H> sh <M> 
TAREA = la <H> ss <M>] 

Cooperative Learning - Classroom an School rll? 
LSPEC = 1cm 

GOALS =1 <M> m <H> w <M> c <H> n <M> 
SOC = mn <H> cq <H> r-f <H>] 

Facilitation at Howard County Sta-fr Development Center rl20 
ALTPROB = et <M> si <M> at <M> 
QUESPROB = or <M> si <M> rd <M> 
DIRPROB = low 

GOALS = h <M> j <H> k <H> m <M> n <M> q <M> r <M> w <M> 
SOC = mn <H> cl <M>] 

Assessment rl21 
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GOALS = o <H> q <H> v <M> 
SOC mn <H>] 

Art and the Exceptional Student rl22 
LSPEC = Isa 

GOALS = e <M> in <M> mn <H> r-f <M> 
TLEV' = el <H> jh <H> sh <M> 
TAREA = art <H>] 

Grouping and Special Students rl23 
LSPEC 1cm 

GOALS =5 <M> m <H> vv) <M> 
SOC = mn <H> cq <H>> 

TAREA = ma <H> la <H> ss <H> sc i <H>] 

Questioning Skills Information rl24 
QUESPROB = info <A> 
LSPEC = Isg 
GOALS = 1 <H> 
SOC = mn <H>] 

Mathemeatics and the Special Student r-125 
LSPEC = Ism 
GOALG = 1 <H> 
SOC = mn <H> 
TLEU = el <H> jh <M> 
TAREA = ma <A>] 

Spel 1 i ng rl36 
LSPEC = Isl 
GOALS 1 <H> 
SOC = mn <H> 

TLEU =,el <H> jh <M> sh iH> 
TAREA = la <A>] 

Author's chair/Peer Conferencing rl27 
ALTPROB = et <M> si <M> 
LSPEC = Isl 

GOALS =1 <H> m <H> w <M> 
SOC = MN <H> CQ <H> 
TAREA = la <A>] 

Dialogue Journals rl28 
ALTPROB = et <M> si <M 
LSPEC = Isl 
GOALS =1 <H> w <M> 
SOC = mn <H> 
TAREA = la <A] 

Assessing Arithmetic Skills and Appendix A rl29 
GOALS = o <H> q <M> 
SOC = mn <H> 
TLEU = el <A> 
TAREA = m <A>] 
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"Learning Strategies Instruction" rl3i 
LSPEC = Isg 
GOALS = 1 <H> 
SOC -.nn <H> 
TLEV = jh <H> sh <H> 

TAREA = la <H> ma <H> ss <H> sc i <H>] 

"Language Experience -for Problem Sol vino in Mathematic 
ALTPROB = et <H> si <M> 
DIRPROB = low 
L ?EC = Ism 
GOALS = 1 <H> 
SOC = mn <H. 
TLEV = el <A> 
TAREA = ma <A>] 

"Using the DFvA to Teach Literary Comprehension at Thrs 
Response Levels'* rl34 

ALTPROB = et <H> si <H> 

DIRPROB = low 

GOALS = n <AH> 

SOC = mn <H> cq <M> 

TLEV = sh <H> jh <M> el <N> 

TAREA = la <A>] 

"Improving Reading comprehension of Disabled Readers T 
Semantic Mapping" rl35 

LSPEC = Isr 

GOALS = 1 <AH> 

SOC = mn <H> 

TAREA = la <H> sci <H> ss <H>] 

"Compensatory and Tutorial Instruction: ri37 
LSPEC = 1cm 
GOALS =1 <H> n <M> 
SOC = mn <H. 
TLEV = jh <H> sh <H> 

TAREA = la <H> ir.a <H> ss <H> sci <H>] 

Direct Instruction of Mathematics rl44 
ALTPROB = et <M> si <M> at <M> 
DIRPROB = 'ow 
LSPEC = Ism 
SOC = mn <H> 
TAREA = ma <A>3 

Teaching Mathematics Effectively rl45 
ALTf OB = et <M> si <M> at <M> 
DIRPROB =1ow 
LSPEC = Ism 
SOC = mn <H> 
TAREA =ma <A>] 

Between the Deaf Child and Reading rl46 
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LSPEC = Isr 
GOALS = e <M> 1 <H. 
SOC = mn <H> 
SITREQ = Chi 
TLEV = el <A> 

TAREA = la <H. ss <M> sc i <M>] 

Instructional Adjustments to Visio Problems rl47 
LSPEC = Isg 
GOALS =1 <H> o <H> 
SOC = mn <H> 
SITREQ = cvi 

TAREA = la <H. ma <H. ss <H> sc i <H> ] 

Language Experience Approach in Primary Science rl4S 
ALTPROB = si <H> et <H. 
DIRPROB = low 
LSPEC = Isr <M> 1 ss <M. 
GOALS = 1 <H. 
SOC = mn <H. 
TLEV = el <A. 
TAREA = la <H. sc i <H>3 

Critical L i sl^n i ng-Read i ng in Remedial Readinq rl4? 
LSPEC = Isr 
GOALS =1 <H> w <M> 
SOC = mn <H> 
TLEV = el <A> 
TAREA = la <H>] 

Viewing Reading Disability from an I n terac t i on i st ^ s 
perspective rl50 

DSPEC = Id <M> 

GOALS = d <M> e <H> o <M> 

SOC = in <H> rf <H> 

PREREQ = rrr 

TAREA = la <H> ss <H> sc i <H> h <H>3 

Analyzing Spelling Error Patterns for Remediation rl51 
GOALS = o <H> 
SOC = mn <H> 

TLEV = el <H> jh <H> sh <M> 
TAREA = la <A>3 

Teaching Expositiory Text Structure rl52 
LSPEC = Isg 
GOALS = 1 <M> 
SOC = mn <H> 
SITREQ = sig 

TLEV = el <H> jh <M> sh <N> 
TAREA = la <H> ss <M> 

Listen-Read-Discuss rl53 
ALTPROB = et 
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DIRPROB = low 
'.SPEC = Isg 
GOALS = 1 <H> n <M> 
SOC = mn <H> 

TLEV = jh <M> sh <H> la <H> 
TAREA = ss <H> sc i <H>3 

Seven Whole-Class Reading Stratgies rl54 
LSPEC = Isg 
GOALS ~ 1 <H> 
SOC = mn <H> 
TLE'v' = jh <H> sh <H> 
TAREA = ss <H> sc i <H> la <H>3 

Motor Imaging: A reading-Vocabulary Strateay rl55 
ALTPROB = et <H> si <H. 
DIRPROB = low 
LSPEC = Isr 
GOALS =1 <H> n <M> 
SOC = mn <H> 

TAREA = la <H> sc i <H> ss <H>3 ' 

Previewing Short Stor^ies rl5.5 
LSPEC = Isr 

GOALS = 1 <H> n <M> w <H> 
SOC = mn <H> 
TAREA = la <A>3 

Rats: Reason to Read rl58 
LSPEC = Isr 
GOALS = 1 <H> 
SOC = MN <H> 
si treq = SIG 
tlev = EL <A> 
tares = LA <H>3 

Language Intervention in Natural Settings rl59 
LSPEC = Isg 
GOALS =1 <M> n <M> 
SOC = mn <H> 
SITRECi = spg 
TLEV = EL <A>3 

Recognizing Special Talents in LD Students rl<50 
AFFECTMODE = p <A. 
DSPEC = Id <M> 
GOALS = d <H> w <H> 
SOC = mn <M> rf <H> 
TLEV = sh <H> jh <M> el <N>3 

Lifs-Size Learning Games rl61 
LSPEC = Isg 

GOALS =1 <H> m <H> n <H> 
SOC = mn <H> 



ISO 



TLE^« = e 1 <A . ■ 

TAREA la <H> ss <M> ir.a <h>3 

Song Picture Books and the Languaqe Disabled Child rl 
LSPEC = Isg 
GOALS =1 <H> n <M> 
SOC = mn <H> r-f <M> 
TLEV -el <A> 
TAREA = la <H> m <H>3 

Science and Li-fe rl6A 
LSPEC = Iss 
GOALS =1 <H> n <M> m <H> 
sec = mn <H> 
PREREQ = red 
TLEV = sh <A> 
TAREA ^= sci <A>j 

Computer-assisted Learning -for hte Mildly Handics.Dped 
LSPEC = Isg 
GOALS = 1 <H> 
SOC = MN <H> 
SITREQ =ecp 
TLEV = el <A> 
TAREA = la <H> ma <H>] 

Reading Instruction -for Mildly Handicapped Adolescent 
LSPEC = Isr 
GOALS =1 <M> o <H> 
SOC = mn <H> 
TLEV = jh <H> sh <H> 
TAREA = la <H> ss <H> sci <H>] 

Learning about Disbilities rl6S 
GOALS = m <H> 
SOC = cq <H> 
SITREQ = scb 
TLEV = el <A>3 

'^<»1 -f-correct i on -for Improving Writing Skills rl69 
LSPEC = Isl 
GOALS =1 <H> o <M> 
SOC = mn <H> 

TAREA = la <H> ss <H> sci <H>] 

Imoroying Comprehension rl70 
LSPEC = Isl 
GOALS = 1 <H> 
SOC = mn <H> 
TLB>; = jh <H> sh <H> 
TAREA = la <A>] 

Academic Learning Time rl71 
ALTPROB = info <A> 



LSPEC = 1 cm 
GOALS = 1 <H>- 
SOC = mn <H>] 

Adi.pt ing Teaching to the Individual D i -f -f erences o-f Learner 
rl72 

LSPEC = 1ms 

GOALS = 1 <M> e <^.> 

SOC = in <M> r-f <H> mn <M> 

PREREQ = rrr] 

Word Processing .o Improve Student Writing rl73 
LSPEC = 1s1 

GOALS = k <M> 1 <H> c <M> 
SOC = mn <H> 
SITREQ = ECP 
TAREA = la <H>] 

The Hidden Minority rl74 
AFFECTMODE = p <A> 
GOALS = d <H> 
SOC = pr <H> in <H>] 

Tan Steps to Good Discipline rl75 
GOALS = w <H> 
SOC = mn <H>] 

Direct Instruction rl76 
DIRPkOB = irj-fo <A> 
LSPEC = 1cm 
GOALS = 1 <H> 
SOC = mn CH>] 

Mind over Minors rl77 
LSPEC = 1 cm 
fjOALS = w <H> 1 <:h> 
SOC = mn <H> r-f <M> 
SITREQ = ecp] 

Guidelines -for Rewriting Text Passages rl79 
GOALS = k <H> 
SOC mn <H> 

TLEV = jr <H> sh <H>] 

The Close Procedure rlSO 
GOALS = o <H> r <H> 
SOC = mn <H> 
TLEV = .jr <H> sh <H>] 

Fry Readbility Formi;1a rlSl 
GOALS = k <H> 
SOC = mn <H>] 

Contract Teaching rl82 
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GOALS = w <M> n <H> p <H> 
SOC = mn <H>3 



Learning Centers rlS3 
t-^v:.. ALTPROB = et <H> si <M> 

LSPEC = IsQ <M> 1 cm <M> 
GOALS =1 <H> k <M> n <M> o <H> 
SOC = mn <H> 
TLEV = el <H> jh <H> 
TAREA = la <H>3 

Vocabulary Centers rl34 
ALTPROB = et <H> si <H> 
LSPEC = Isl 

GOALS = k <M> 1 <H> n <M> o <H> 
SOC =mri <H> 
TLEV = el <H> jh <H> 
TAREA = la <H>] 
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Abstract 



'•..Is paper describes SNAP (Smart Needs Assessment 
Program), an expert system that selects and recvimmends 
training options for regular education teachers of 
malnstreamed handicapped students. SNAP Is Implemented 
using two distinct types of knowledge representation and 
inference jnechanlsms for two distinct phases of solving the 
problem. The first subproblem Is to determine "What 
training does the teacher need?" A deductive Inference 
system that represents knowledge ts a series of rules 
provides answers to this question. These rules were derived 
from teacher effectiveness literature, from responses to an 
adaptation of the "Stages of Concern" questionnaire, from 
training goals teachers select for themselves, and from 
Information about their specific teaching situation. The 
subproblem Is to determine, "What training options are 
available that will meet these training needs?" A 
fraoie-based, hypothesize-and-test inference system based on 
abduction is used to solve this sub-problom. Training 
options (such as videotapes and films, local inservice 
workshops, journal articles, book chapters, observations of 
expert teachers* classrooms, etc.) are represented by 
descriptions, and the inference mechanism "hyoothesizes" 
different combinations of training options until it finds 
ones that "cover" all a teacher's training needs with the 
smallest number of options. Because the abductivt! component 
of SNAP Is Implemented using an algorithm based o'a a 
procedure normally used for diagnostic problem solving (even 
though training option selection-is not inherently 
diagnostic), extensive testing is currently being done to 
determine the value of using a diagnostic paradigm for a 
nondiagnostic problem. 

The advantages of this approach to planning for teacher 
training over conventional approaches are dircussed more 
fully In the paper. An expert system approach allows for 
analysis of individual teachers' training needa, and the 
selection of training programs that are uniquely suited to 
-•iach teacher. Furthermore, the application of two types of 
infers iCe mechanisms to solve a problem allows for expert 
system technology to be extended to a broader range of 
topics in regular and special education. 
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I. Introduction 

This paper describes research done at the University of 
Maryland, Department of Special Education, on a Smart Needs 
Assessment Program (SNAP), an expert system combining both 
deductive and abductlve Inference to provide decision 
support for planning Individual training programs for 
regular education teachers of malnstreamed handicapped 
students. Determining problems with other approaches for 
teccher training and attempting to use artificial 
Inte'lllgenced technology to develop a new approach were 
Important goals of this research. One of the major efforts 
of the research Involved the selection of knowledge 
representation and inference methods most suitable for the 
domains of research on teacher effectiveness, descriptions 
of training opportunities, and planning for effective 
training programs. 

Important issues evolving from the effort include the 
advantages and disadvantages of using an unusual approach 
Including both deductive and abductlve inference within a 
single system. 
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II. Description of SNAP 

Since 1975 when P.L. .94-142 was passed by the U.S. 
Congress, millions of handicapped students have been 
removed from Isolated Instructional settings and placed in 
mainstream classrooms. There are many educational and 
social advantages r,o this arrangement, but the problems for 
teachers have been substantial. Most "regular education" 
teachers, or teachers of mainstream classrooms have little 
formal training in special education £er se. In teaching 
children with educational disorders, or in organizing and 
managing a classroom that includes some handicapped 
students. Formal training, however. Is not necessarily a 
measure of an experienced teacher's skill In dealing with 
such a situation. In fact, some teachers adapt to the 
change with little difficulty, while others remain at a loss 
after several years with a mainstream classroom. The 
typical response of school districts to their teachers' 
needs for professional development for malnstreaming has 
been to offer and/or require very general courses designed 
to help teachers adjust to their mainstream classes and 
ce&ch all their students effectively. This "shotgun" 
approach has some major limitations, however. First, It Is 
inefficient, since some teachers, despite a lack of formal 
training, are competent at the task without additional 
training. Other teachers with negative attitudes toward 
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handicapped students are unlikely to gain the skills 
Included in the courses unless their negative affect Is 
dealt with directly and effectively first. Secondly, the 
general course approuch is limited in that a general course 
cannot help teachers with problems they need to solve 
Immediately, or deal with specific issues that arise in 
unusual situations. By offering courses that attempt to 
please everyone, they end up pleasing no one. 

SKAP addresses the shortcomings of the typical attempts 
to help regular education teachers become more effective 
teachers of mainstream classrooms by providing suggestions 
for training experiences selected for Individual teachers 
based upon their attitudes toward malnstreaming and teaching 
handicapped students, their current skill j»s a classroom 
teacher, and their own professional goals. Interests, ana 
concerns, SNAP is an expert system that uses contextual 
Information derived from Interacting with an Individual 
teacher, from data obtained through observation of th^ 
teacher's own classroom, from a teacher's profile on an 
Instrument measuring the teacher's "stage of concern" about 
matnstreaming, and from the teacher's stated goals and 
Interests to determine the "training needs" of the teacher 
by using a rule-driven deductive inference mechanism. 
Subsequently, these training needs are used In an abductlve 
inference system to select from a database the most 
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efficient set of training options that will address all the 
training needs for that teacher. 

II. Use of Two Inference Methods in SNAP 

Abduction and deduction are two Inference methods 
commonly used in expert systems. The main distinction 
between them Involves the concept of uncertainty. For 
example, suppose we have a fact, "if A, then B". If A is 
true, then ws can deduce with absolute certainty that B is 
also true. On the other hand, if B is known to be true, 
tfien by abduction we can conclude that A ma^ be true. SNAP 
uses both deductive and abductive inference mechanisms. 

An example of the use of deduction in SNAP can be seen 
in the production rule in Figure 1. It is worth noting 
that althcugh a deductive inference Is being made, the use 
of a certainty factor Incorporates some of the Inexactness 
necessary in most real-world decision making. Therefore it 
might be argued (Charniak and HcDermott, 1985'/ that this is 
an example of abduction. However, the authors of SNAP refer 
to this sort of Inference as deduction and feel justified in 
(ioing so for two reasons. The first reason is that in the 
production system component of SNAP, the use of certainty 
factors in rules reflects lack of certainty of the source of 
the knowledge rather than a lack of confidence in the 
inferences themselves. This is a contrast to many other 
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applications of expert systems where the expert knowledge Is 
better defined, but more than one rule may apply for a given 
problem. The second reason Is to distinguish this kind of 
Inference from "true" abduction as Illustrated In the next 
example. 



Insert figure 1 about here 



"True" abduction In SNAP Is best illustrated by the 
following example. 

Suppose, there exists a training option T 
which addres'.es the needs of teacher X 
who has a blind student In his/her 
class. Then T may be a good training 
experience for X. 

Such an inference is possible Iji SNAP because the training 
options are organized within t.ie knowledge base as frames 
{J5«e Waterman, 1986 chapter 7 for a discussion of frames) 
where each frame contains descrlpf.e Information for a 
specific training option. The knowledge representation and 
inference mechanisms used In SNAP will be discussed in more 
detail In the next section. 
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An examination of the attribute hierarchy will help to 
understand the relationship of the two parts of the t^^'-.al 
expert system to the available information and decision 
making processes. As Figure 2 Illustrates, the total SNAP 



Insert figure 2 about here 

system is composed of two parts that operate separately and 
sequential ly, 

IV. Software Used In SNAP 

SNAP Is being Implemented on an IBM PC-XT microcomputer 
using KES (Knowledge Engineering System), an expert system 
building tool which allows for both typical production 
systems with a backward chaining inference mechanism (see 
Waterman, 1986, Chapter 7 for dlscui-nlons of forward and 
backward chaining) ana frare-based knowledge bases w1t>. a 
not-so-typical Inference mechanism b^sed on the notion of 
minimal set covering. (Reggia, Nau & Wang, 1983) The 
subsystem for building production systems Is called KE' 
and the -:jbsystem for building frame-based expert syste- S 
callei ^ES.HT ( hypotheslze-and-test) . Dut to the current 
unavailability of KES.HT for microcomputers, the frame-based 
component of SNAP U now written using KMS.H'I, a software 
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package developed at the University of Maryland which Is the 
predecessor of KES.HT (Reggia & Perrlcone, 1982), 

The minimal set covering model for diagnostic problem 
solving Is Illustrated by Figure 3, Let D be a set of 
disorders and M be a set of manifestations. Typically, D 
would correspond to diseases and M would correspond to 
symptons. Furthermore, a causal relationship exists between 
0 and H such that for every disorder d In D, the subset of M 
containing all manifestations caused by d Is known. The 
objective of minimal set covering Is, given a subset of M of 
manifestations present, to find all minimal subsets of D 
such that all present manifestations are •'covered*'. I.e., 
are caused by at least one disorder In the subset of D 
(Reggia et al , 1983). KMS.HT (and KES.HT) uses an Inference 
method based on this notion of minimal set covering. 



Insert Figure 3 about here 



It should be clear that the Inference mechanisms of 
KES.PS and KES.HT Involve deduction and abduction 
respectively. The Inference mechanism of KES.HT Involves a 
repetetlve process which keeps track of a subset of D 
covering the currently known manifestations and modifies 
that subset as new manifestations are discovered by means of 
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questioning the user (Reggia & Perrlcone, 1982; Reggia et 
al, 1983)« 

V« Abduction and Deduction In SNAP 

Conceptually, SNAP can be thought of as two expert 
systems* One system determines training needs for teachers 
on the basis of classroom observations, their subject areas, 
the achievement level of their students, and other data* 
The other expert system prescribes training options to 
"cover" the training needs determined by the ftrst system, 
using Information regarding the teacher*s role, experience 
level, and chosen learning goals as additional Input* Based 
on the tips for choosing an Inference mechanism In KES 
(Softwar Architecture 2 Engineering, 1986) a rule-based 
deductive approach was selected for the first system and a 
frame*based abductlve approach w.as selected for the second 
system. 

The purpopse of this deductive knowledge base Is to 
determine the values of TES (Teacher Effectiveness Scale) 
which uses Information obtained from observations to 
determine how effective the teacher Is in the areas of 
providing the appropriate amount of direct Instruction 
(DIR), assuring an adequate amount of academic learning time 
(ALT), and providing all students with adequate 
opportunities to respond to questions successfully (QUES). 
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The rules for determining the level of teaching skill 
Indicated by the observation data were derived from recent 
research on teacher and school effectiveness (Wittrock, 
1986). Additional training needs come from an algorithm 
analyzing teachers' responses to an Instrument called the 
"Stages of Concern About Malnstreaming" (SOC), and from 
teachers' responses to a questionnaire about their Interests 
and goals for their own professional development related to 
malnstreaming (GOALS). 

• 

A rule**based approach was used to determine training 
needs for several reasons* The knowledge to be 
incorporated Into the knowledge base naturally exists as 
research reports published In professional journals and 
technical reports. With some er.ceptlons, the Handbook of 
Researc h on Jeaching (Wittrock, 1986) reports summaries of 
much of this research literature. These reports typically 
describe populations^ settings* Independent and dependent 
variables In some detail. These descriptive data enable the 
knowledge base author to define attributes and their values* 
and the research results are used to determine 
antecedent-consequent relationships that are written as 
production rules. Combinations of attributes not 
specifically covered by research studies and conflicting 
results were written Into production rules by considering 
the consistency and general direction of flnd-'ngs of the 
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research literature In a holistic sense. Reduced certainty 
factors reflect the degree to which a rule Is removed from 
actual research findings. These procedures result In a 
fairly natural form of representation for the knowledge. 

Another factor favoring the use of rules Is a low level 
of context dependence; I.e., the value of an Inferred 
attribute Is Influenced by the values of a relatively small 
number of other attributes. Although many of the Inferred 
attributes In the rule^-based component of SNAP meet this 
requirement, the direct instruction ratio (DIR) 
categorization Is a notable exception^ and created some 
difficulties which will be discussed In a subsequent 
.section. 

The second part of the SNAP system, the abductlve part, 
uses training needs and data concerning contextual factors 
affecting the selection of training options to select the 
actual set of training options that will be recommended for 
an Indl vidual teacher. KES.HT uses the principle of 
minimality to select the smallest number of separate 
training options that will "cover" all the training needs 
for an Individual teacher. Contextual Information, called 
"setting factors" In this case. Is used to select only those 
options that meet the contextual requirements for a given 
training option, but are not "needs" that the selection must 
"cover." For example. If a given teacher teaches a third 
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grade class, tralining options geared for an elementary 
teacher rather than a high school teacher would be 
appropriate; however being a third grade teacher Is not a 
training need Itself, but a factor limiting which options 
should be recommended* 

The training options selection component of SNAP 
differs from the training needs assessment component In 
several ways and, therefore, a frame-based representation 
and abductlve inference mechanism were chosen* Unlike the 
data on teacher effectiveness, the training options used in 
SNAP exist as a database, where each record describes a 
training option. Therefore, the knowledge to be encoded 
preexists In a frame-like format. Also, the classification 
of training options is not primarily categorical. In fact, 
there Is a lot of overlap between the training options in 
the sense that several of them may address similar training 
needs, although some may serve "better" than others. 
Finally, the training options selection process Is heavily 
context dependent In that selection of a given training 
option typically depends on a fairly large number of 
training needs as well as additional factors, such as the 
teacher*s experience level, subject, and grade level. 
Hence, the number of rules needed to encode training options 
selection would ^e prohibitively large, considering that 
SNAP currently uses a database of well over 200 training 
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options. All of these factors favor the use of a 
frame-based knowledge representation and a 
hy potheslze-and-test Inference mechanism over the use of 
production system. 

At this point, one might ask the question, "Why not use 
a database management system for selecting the training 
options?" There are two principal reasons why not. First, 
a DBMS Is "dumb"; It does not know when to stop asking 
questions. For SNAP, an "Intelligent" program capable of 
asking only what It needs to know In order to make an 
Intelligent selection Is desired. For example, let us 
ausume that after asking a series of questions SNAP has 
narrowed the choice of training options for a teacher down 
to a small number, all of which are appropriate for any 
experience level. It then follows that It Is unnecessary' 
for SNAP to know the teacher's experience, so It should not 
be asked. Thus a "smart" question generating process Is 
required. 

The second reason for not using a DBMS relates to the 
principle of parsimony. Since many of the training options 
In SNAP cover similar training needs. It Is quite probable 
that a large number of training options will be appropriate 
for a typical teacher. However, It Is more desirable to 
limit the number prescribed to only a few due to economic 
considerations as well as time constraints on the part of 
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the teacher. KMS.HT fulfills this goal by always selecting 
the smallest number of training options possible which can 
address all of the training needs present. Unfortunately, 
this solution results In a lack of flexibility wi^lch will be 
discussed In the next section. 

Another advantage of using abductlve Inference in this 
system Is Its simplicity. Figure 4 Illustrates a cas<i where 
a training option description Includes all the information 
that it would require more than 40 rules to cover* This 
efficiency is typical of cases where there are many 
contextual variables that would need to be systematically 
varied, since all possible values for all attributes would 
have to be Included. 



Insert figure 4 about here 



VI* Problems 

One of the problems with using a deductive inference 
system is the "explosion" of rules when numerous contextual 
factors are needed to contribute to the decision-making 
process. Figure 1 is an example of one rule which indicates 
its limited applicability when the contextual features vary. 
The particular piece of research upon which this rule was 
based Includes two Important contextual limitations of the 
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findings, "grade" and •'SES". However, the body of teacher 
effectiveness research as a whole Indicates that the amount 
of direct Instruction that Is appropriate for students 
varies depending upon the age and socio-economic status of 
the students (as Indicated by the rule In Figure 1), but 
also depends upon the subject matter being taught and the 
goals the teacher has for the students. By expanding rules 
based directly on research, such as this one, to Include 
contextual variables found to be Important In other, related 
research, additional rules are derived that cover as many 
different values for the contextual features as possible. 
In the case of the DIR portion of the SNAP system, which Is 
but a small part of It, fifteen original rules "exploded" 
Into 176 In the most recent version of the system. This 
explosion makes the knowledge base too large to be tested 
and maintained easily, and diminishes the directness of the 
relationship between the research literature and the 
production rules because the research base is Incomplete. 

Another problem occurs as a result of the "minimality" 
principle Incorporated In the abductlve portion of the SNAP 
system. According to thl5 principle of minimality, KES.HT 
will select the smallest number of training options that 
cover all the training needs of an Individual teacher. In 
the case of training, however. It Is not at all clear that 
the smallest number of training options Is the most 
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desirable. The result of such a process could be the 
selection of one "shotgun approach" course, exactly the 
option that SNAP Is designed to avoid. Since a general 
course Is designed to cover all topics for all grade levels, 
all subject areas, all types of handicaps, etc.. Its 
description would cover all those features, and hence would 
allow it to be selected as one single training option that 
will satisfy a teacher's training needs. !n selecting and 
coding training options, SNAP's knowledge engineers have 
usually avoided Including such general options In the 
knowledge base, preferring to focus on options addressing 
more specific needs. 

As mentioned earlier, the minimality requirement for 
KMS.HT causes some major problems. Perhaps the most 
apparent of these shortcomings 'is simply that for SNAP, 
minimality is not really preferable. Although minimizing 
the size of the cover for a teacher's training needs is 
desirable, it is also desirable to give a teachar multiple 
training options covering the same training neod where the. 
additional training would benefit the teacher. A solution 
to this problem would be to use some criterion other than 
minimality to keep the number of training options selected 
small. Computer scientists concerned with this area are 
currently seeking alternatives. to currently used methods. 
(Peng 1986, Chu 1985) 
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Another problem caused by mlntmallty Is that often 
non-specific "shotgun" training options which cover a lot of 
training needs but not very well are favored by KMS.HT over 
training options that are specifically geared toward a 
single training need. Again the only truly satisfactory 
solution to this problem would be to alter the KMS.HT 
algorithm. As a compromise solution, the criteria for a 
training option to cover a training need was strengthened in 
order to decrease the number of weak "shotgun" training 
options in the knowledge base. 

Perhaps the most important issue concerning SNAP is 
that It is an attempt at using a diagnostic problem solving 
paradigm to solve a non-diagnostic problem. This attetupt to 
apply abductive diagnostic inference to a non-diagnostic 
problem is also being studied in the area of natural 
language processing (Dasigi i Reggia. 1986). The SNAP 
system equates training options with "diseases" and training 
needs with "symptoms" even though it is not clear that such 
a relationship is valid. It should be pointed out that the 
non-diagnostic, nature of SNAP is really the root of the 
difficulties previously mentioned with respect to the 
minimality issue. Hhereas minimality is a reasonable and 
even sensible requirement In applications such as medical 
diagnosis, it does not seem to be optimal for SNAP. With 
more testing it will be determined whether or not training 
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option selection in SNAP cun be satisfactorily Implemented 
using the diagnosti cal ly motivated parsimonious covering 
pri ncl pie. 

YIK Future Testing of SNAP 

The SNAP system Is currently in Its final phase of 
development and testing. Although the Individual components 
of the system have been field tested, a full-scale test has 
not yet been conducted. It should be remembered that the 
current Implementation of SNAP Is experimental • Questions 
regarding the feasibility of using microcomputer-based 
expert systems for education, the relative effectiveness of 
deductive and abductlve systems, and the quality of 
performance of such systems In education are of Importance. 
In addition, the knowledge engineering procedures needed to 
transform the existing research literature Into a knowledge 
base are being explored e.nd questioned. 

To answer these questions, 26 experienced regular 
education teachers who have mainstream classrooms and are 
enrolled In a Master's Degree program In Curriculum and 
Instruction are using SNAP within the context of a special 
education course on mal nstreami ng. Unlike future users of 
SNAP, however, a project staff member Is present while they 
are using the system to document their comments, 
difficulties, etc. in using the system. Another 
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modification made for this test per1o<i Is that teachers' 
data Is being recorded both on » diskette, and on the hard 
disk of the computer. In the final Implementation data will 
only be recorded on the diskette so that the privacy of 
Individual teachers' Information is maintained. In this 
testing of SNAP, however, the data recorded on the hard disk 
will be used to compare the training options selected by 
SNAP with those recommended by teacher education experts 
who will use teachers' data for this selection process. 
Project staff members will Interview the teachers when the 
training options have been recommended, and after the 
teachers have participated In theme In this way. 
Information concerning teachers' attitudes toward the 
selected training options, their perceived relevance to 
specific teachers, and the accuracy of their content and 
descriptis/i in the knowledge base can be ascertained. 
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VIII« Conclusion 

Using KES (and, temporarily KMS } has enabled the 
development of an extensive expert system combining the 
advantages of a rule-based deductive component with a 
frame-based abductlve component* In this SNAP application, 
relying on either one alone would have been nearly 
Impossible. The disadvantages of the two subsystems became 
apparent when the research resulted In the generation of a 
deluge of rules, and when the principle of minimality 
required the careful scrutiny and revision of training 
options in the knovfledge base* 

It Is clear that for this application, as well as 
others that rely on highly contextuallzed Information and 
complex Interrlatlonshlps among alternatives to be selected, 
abduction Is at useful. If not necessary, tool for 
Incorporating expert knowledge Into a functioning expert 
system* In educational settings which require the 
consideration of complex relationships among student, 
teacher, classroom, school, and numerous other variables, 
abductlve frame-based systems allow for simultaneous 
consideration of all variables relevant to a decision that 
may have a major Impact on a student's schooling. Relying 
on deductive rule-based systems alone would require systems 
of an unwieldy size, and would result In large numbers of 
single recommendations without regard for effective 
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combinations of alternatives. Further researach is 
currently under way to combine deduction and abduction In 
other expert system Implementations for educators. 
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The roT^rbased component of SNAP Is implemented on a 
microcomputer using KES (Software Architecture and Engineering, 
1985), an expert system authoring tool. Due to the current 
unavailability of the frame^-based component of KES for 
microcomputers, this part of SNAP is implemented using KMS 
(Reggia and Perricone, 1982), an experimental predecessor to KES 
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J^pendix K 



Rules in the Teacher 
Effectiveness Expert System 



type 
\snapkb 



text: 

{certification: "This knowledge base determines training", 
"needs related to the teacher effectiveness literature", 
"on academic learning time, questioning skill, and direct", 
"instruction. It was written in 1985 by Jackie Haynes and", 
"revised and enlarged by Jackie Haynes and Jennie Pilato", 
"in January, 1986. "} 

{certainties: "Certainty factors were determined by following", 
"the following rules: If a substantial piece of research was", 
"used to write a rule and all elemants embodied in the resarch", 
"are contained in the rule, the certainty factor assigned is 1.0.", 
"If the rule was derived from another rule with a certainty factor" 
"of 1.0 by changing one attribute, the certainty factor is reduced" 
"bj' 0. 1'. For each additional change to the original rule, another" 
"0.1 is subtracted from the certainty factor for that rule. It is" 
"therefore possible to determine how far removed a rule is from the 
"original research upon which it was based by examining its", 
"certainty factor. "> 



{ref erencel : 


"Anderson & Scott, 1978"} 


{ref erence2: 


"Brophy, 1983"} 


{references: 


"Brophy & Good, 1986"} 


{referenced: 


"Centra & Potter, 1980"} 


{references: 


"Emans, 1983"} 


{ref erenceb: 


"Evertson, 1980"} 


{reference?: 


"Fisher, Berliner, Filby, Marliave, Cahen, & Dishaw 




"1978"} 


{ref erence8: 


"Good & Grouws, 1979"} 


{ref erence9: 


"Medley & Crook, 1980"} 


{ref erencel 0 
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attributes: 

alloctm: real 

[constraint: alloctm ge 0.0 and alloctm le 600.0] 
{explain: "Allocated time is the total amount of time that COULD", 
"be used for instruction. It excludes time used for recess, lunch, 
"school plays, transition from one class to another, etc. "} 
{definition: "The amount of time students are in their classroom in 
"given school day"}. 



teachtm: real 

[constraint: teachtm ge 0.0 and teachtm le 600.0] 
{definition: "Teaching time is the amount of time a teacher", 
" spends providing direct instruction to the entire", 
"class or a subgroup of the class in a given school day. "}. 

DIR: real 

[constraint: DIR ge 0 and DIR le 1.0] O j r\ 
Llyy (calculation: teachtm/alloctm] ^lU 



" instruction that is actually used for that purpose"). 

DIRval: mlt 

(high, medium, Iok) 

{definition: "the evaluation of the teacher's reported data on", 

"the amount of direct instruction provided in the classroom,", 
"considering other variables that affect Hhat this value", 
"should be"}. 

SES: sgl 

( poor, middle class, upper class) 

{question: "Hhat is the socio-economic status of your students?"} 
{definition: "the general socio-economic status of the majority of", 
" the students in a given classroom"}. 

Tarea: mlt 

( mathematics, 
English 

{question: "English (including study skills and reading)"}, 
reading 

{question: "reading (at the elementary level)"}, 
language arts, 
science, 
social studies, 
art, 
music, 

physical education, 
home economics, 
foreign language, 
health education, 
industrial arts, 

special education {explain: "Special Education, any grade level"}, 
other) 

{question: "Hhat subject do you teach?"} 

{definition: "specific skill and/or content areas you teach, or," , 
"if you are a generalist, any areas that you ", 
"specialize in"}. 

science focus: sgl ^ 
( labs, lecture 

{question: "lecture and demonstration"}, 
discussion) 

{question: "Hhat form of instruction in science is most like ", 
"Hhat you Here doing during the self observations?"}. 

tlevel: sgl 

( primary 

{question: "Kindergarten thru Grade 3"}> 
intermediate 

{question: "Grades 4 thru 6"}, 
junior high 

{question: "Any grade in a school including grades 6 thru 9"}, 
high school 

{question: "Any grade in a school including 9 thru 12"}) 
{question: "Hhat level do you teach?"} 

{definition: "The level at which you are assigned (not the", 
"instructional level of your students) to teach most of", 
"the time. "}. 

sgl 

(tests {question: "improving achievement as reflected in", 
" standardized test scores"}, 
self concept {question: "enhancing students' self concept"}, 
school attitude {question: "improving students attitudes", 
" tonard school"}. 



uiiaiiVaix-i! muiSLiuii. i.iiiJiuiiiii& JLuuLiiLJ Lwrep^^ewnfiw!!^ 

" and problem solving"}) 
{question: "Hhat is your most important teaching goal?"}. 



achlevel: mlt 

(high, average, Iok) 

{question: "Rhat is the achievement level of most of your students?"} 
{definition: "The achievement level of your students relative to", 
" national norms on achievement tests."}. 



reading skills: mlt 

( beginnning rdg 

{question: "beginning reading skills (decoding, phonics,", 
" letter recognition)"}, 

basic skills 

{question: " basic skills in reading (phonics, syllabication, ", 
"prefixes & suffixes, root words, etc.)"}, 

vocabulary 

{question: "learning to recognize, use, and/or spell new words "}, 
comprehension 

{question: "developing the ability to understand text at literal,", 
"inferential, and problem solving levels"}) 

{question: "Hhat reading skills were you teaching during the", 
"time you were conducting the self observation ?"}. 

language skills: mlt 

(oral expression 

{question: "oraJ expression (giving oral reports, speeches, etc.)"}, 
grammar 

{question: "grammar (subject-verb agreement, parts of speech,", 
"types of sentences, correct usage, etc.)"}, 
language mechanics 

{question: "mechanics of written language (capitalization,", 
" punctuation, etc."}, 

writing 

{question: "writing, including creative and expository writing"}) 
{question: "Hhat language arts skills were you teaching during the", 
"time you were conducting the self observation?"}. 

DiRprob: sgl 

( none, high, low) 

{explain: "DIRprob means there is a problem with DIR, and the", 
"value high or low indicates the direction of the", 
"problem. "}. 



% 



externals: 

allocatedtime: 

C program: "timal"] 
C outputs: alloctm] 
C outputf ilo: "timal. dta"] . 

teachingtime: 

C program: " timtc"] 
C outputs: teachtm] 
I outputf ile: "timtc. dta"] . 



rules: 

DIRotherl: 
' if 

tlevel = primary 1 intermediate 
O and Tgoal W tests 

ERIC and DIR ge 0. 8 2 1 2 '-'^^ < O'OPV AVAILABLE 



V then ^ 
DIRval = lOR <0. 6> . 

message "If you are trying to improve your students* creativity", 
"problem solving skills, attitude tonard school, or self concept,", 
"it Rould be better to use less direct instruction and allOK more", 
"time for other types of activities.", 
endif. 



DIRother2: 
if 

tlevel = primary 1 intermediate 

and Tgoal # tests 

and DIR It 0. 8 

and DIR ge 0. 5 

then 

DIRval = medium <0. 6> . 

message "If you are trying to improve your students' creativity", 
"problem solving skills, attitude toward school, or self concept,", 
"it Hould be better to use less direct instruction and allOH more", 
"time for other types of activities.", 
endif. 



DIRother3: 
if 

tlevel = primary I intermediate 

and Tgoal ^ tests 

and DIR It 0. 5 

and DIR ge 0. 33 

then 

DIRval = high <0. b> . 

message "If you are trying to improve your students* creativity", 
"problem solving skills, attitude toward school, or self concept,", 
"you are giving them some direct instruction, Hhich is essential, ", 
"but you are also doing lots of other types of activities which are", 
"better than direct instruction for promoting your major goals. ". 
endif. 



DIR1a: 

if 

tlevel = primary I intermediate 

and Tarea = mathematics I music 

and SES = poor 

and achlevel - loK 

and DIR ge 0. 8 

then DIRval = high <0. 9>. 

message "You are conducting a great deal of direct instruction", 

"in your classroom. This is a sound instructional practice. " 
"Research indicates the importance of providing a high", 
"amount of direct instruction with low achievement students", 
"and Kith low SES students. ", 

H tt 

display attach references of kb. 
display attach reference8 of kb. 
endif. 



DIR1 b: 



ERIC 



if 

tlevel = primary | intermediate 

and Tarea ^ mathematics I music 

and SES ^ middle class ! upper class 

and achlevel = Ion 

and DIR ge 0. 8 

then DIRval = high <0. 7>. 

message "You are conducting a great deal of direct instruction", 

"in your classroom. This is a sound instructional practice. " 
"Research indicates the importance jsroviding a high amount 



**of direct instruction Kith Iok achievement students. \ 

rt tt 

display actach references of kb. 
display attach references of kb. 
endif . 

DIRIc: 

if 

tlevel = primai^y | interme diate 

and Tared = mathematics | music 

and SES - poor 

and aciilevel = average 

and DIR ge 0. 8 

then DIRval = medium <0. 7>. 

message "You are providing a great deal of direct instruction in your", 

"math class. EoKOver, you may help average students improve", 

"their achievement by reducing direct instruction somewhat,**, 

"thereby allowing more time for independent seatwork. ", 
It tt 

display attach reference",? of kb. 
endif. 



DIR1d: 

if 

tlevel = primary | intermediate 

and Tarea = mathematics \ music 

and achlevel = high 

and DIR ge 0. 8 

then DIRval = lOR <0. 9>. 

message "You are providing your high achievement students Kith more", 

"direct instruction than they require in mathematics. They", 

"may benefit from having more time in class for independent", 

"seatRork. ", 
tt tt 

display attach referencelS of kb. 
endif. 



DIR1e: 

if 

tlevel = primary I intermediate 

and Tarea = mathematics | music 

and SES = middle class | upper class 

and achlevel = average 

and DIR ge 0. 8 

then DIRval = high <0. 7>. 

message "You are conducting a great deal of direct instruction in", 

"your classroom. This is a sound instructional practice.", 
ti It 

display attach references of kb. 
endif. 



DIRIal: 



ERIC 



if 

tlevel = primary 1 intermediate 

and '^'jiVesi = mathematics 1 music 

or Tgoal = tests 

and SES = poor 

and achlevel = low 

and DIR It 0.8 

and DIR ge 0. 7 

then DIRval = medium <0. 8>. 

DIRprob = loK. 

message "You are providing a moderate amount of direct instruction.", 

"A higher amount is important for helping students develop", 2 I 



"basic skills. Your students Ki41 benefit from frequent but 

"brief periods of guided practice. 
II II 

display attevch references of kb. 
display attach references of kb. 
endif. 

DIR1b2: 

if 

tlevel = primary I intermediate 

and Tarea = mathematics | music 

and SES = middle class I upper class 

and achlevel = loK 

and DIR It 0. b 

and DIR ge 0. 7 

then DIRval = medium <0. 6>. 

DIRprob = low. 

message "You are providing a moderate amount of direct instruction." 

"A higher amount is important for helping students develop", 

"basic skills. Your students will benefit from frequent but 

"brief periods of guided practice. ", 
II II 

display attach references of kb. 
display attach references of kb. 
endif. 



DIR1c3: 

if 

tlevel = primary I intermediate 

and Tarea = mathematics I music 

and SES = poor 

and achlevel = average 

and DIR It 0. S 

and DIR ge 0. 7 

then DIRval = medium <0. 6>. 

message "You are providing a moderate amount of direct instruction." 

"A higher amount is important for helping students develop", 

"basic skills. Your students will benefit from frequent but 

"brief periods of guided practice. ", 
tt It 

display attach references of kb. 
display attach references of kb. 
endif. 



DIRIdU: 

if 

tlevel = primary I intermediate 

and Tarea = mathematics | music 

and achlevel = high 

and DIR It 0. S 

and DIR ge 0. 7 

then DIRval = medium <0. S>. 

message "You are providing a moderate amount of direct instruction. " 

"For high achievement students, less direct instruction is", 

"recommended so that students have adequate time for", 

"independent seatwork. 
ft II 

display attach reference15 of kb. 
endif. 



DIRIeS: 



ERIC 



if 

tlevel = primary | intermediate 
and Tarea = mathematics | music 

and SES = middle class | upper class 2^ ^ 



and dchlevel - ^^veras^ 

and DIR It 0.8 

and DIR ge 0. 7 

then DIRval = medium <0. 7>. 

message "You are providing a moderate amount of direct instruction. 

"A higher amount is important for helping students develop", 

"basic skills. Your students will benefit from frequent but", 

"brief periods of guided practice. ", 
It II 

display attach references of kb. 
display attach reference8 of kb. 
endif. 

DIR1f6: 

if 

tlevel = primary | intermediate 

and Tarea = mathematics \ music 

and SES = .poor 

and achlevel = Ion 

and DIR go 0. 5 

and DIR It 0.7 

then DIRval = lOK <0, 7>. 

message "You are providing a low amount of direct instruction. To", 

"improve your students* math achievement, you should provide", 

"a lot more direct instruction. Your students will benefit**, 

"from frequent but brief periods of guided practice. ", 
II II 

display attach references of kb. 
display attach references of kb. 
endif. 

DIR1g7: 

if 

tlevel = primary i intermediate 

and Tarea = mathematics { music 

and SES = middle class { upper class 

and achlevel = Ior 

and DIR ge 0. 5 

and DIR It 0.7 

then DIRval = medium <0. 5>. 

message "You are providing a low amount of direct instruction. To"> 

"improve your students* math achievement, you should provide", 

"more direct instruction. 
It II 

display attach references of kb. 
display attach references of kb. 
endif. 



if 

tlevel = primary I intermediate 

and Tarea = mathematics | music 

and SES = poor 

and achlevel = average 

and DIR ge 0. 5 

and DIR It 0.7 

then DIRval = low <0. 5>. 

message "You are providing a low amount of direct instruction. To", 

"improve your students* math achievement, you should provide", 

"alot more direct instruction. Your students Hill benefit", 

"from frequent but brief periods of guided practice. ", 
It II 

display attach references of kb. 
display attach references of kb. 

endif. 2 t 6 



DXRIiQ: 

if 

tlevel = primary I intermediate 

and Tarea = mathematics I music 

and achlevel = high 

and DIR ge 0. 5 

and DIR It 0.7 

then DIRval = high <0. 9>. 

message "The amount of direct instruction you are providing your*\ 
"high achievement students is loK but appropriate. It is", 
"important to give them time for independent seatHork. ", 

H tt 

display attach referencelS of kb. 
endif. 



DIRIjlO: 

if 

tlevel = primary | intermediate 

and Tarea = mathematics I music 

and achlevel = average 

and SES = middle class I upper class 

and DIR ge 0. 5 

and DIR It 0. 7 

then DIRval = low <0. 7>. 

message "You are providing a loH amount of direct instruction. To", 

"improve your students* math achievement, you should provide 

"more direct insti*uction. ", 
tt tf 

display attach references of kb. 
display attach references of kb. 
endif. 

MRI k11: 

if 

tlevel = primary 1 intermediate 
and Tarea = mathematics { music 
and DIR It 0. 5 
then DIRval = loK. 

message "Direct instruction is important in the teaching of basic", 

"skills. you are not providing direct instruction at", 

"least half of most of your math classes, your students are" 

"not receiving enough direct instruction.", 
tt tt 

display attach references of kb. 
endif. 



DIRIfa: 



»goifb: 



if tlevel - primary 

and Tarea = reading 

and reading skills $ comprehension 

and achlevel - average 

and SES = middle class ! upper class 

and DIR ge 0. 8 

then DIRval = high <0. 8>. 

message "You are conducting a great deal of direct instruction in", 

"your classroom. This is a sound instructional practice.", 

"The high amount of direct instruction is particularly", 

"important Khen basic skills are being taught. ", 
II tt 

display attach references of kb. 
display attach reference9 of kb. 
endif. 

if tlevel = primary 



ERIC tlevel = primary O 1 

ijMmimtrmm and Tarea i reading j mathematics ! language arts ^1 ( 



and Tgoal = tescs 

and achlevel = average 

and SES = middle class I upper class 

and DIR ge 0. 8 

then DIRval = high <0. 8>. 

message "You are conducting; a great deal of direct instruction in", 

••your classrocrti. This is a sound instructional practice. 

"The high amount of direct instruction is particularly", 

"important Khen basic skills are being taught,", 
It tt 

display attach references of kb. 
display attach reference9 of kb. 
endif. 



DIRIga: 

if tlevel = intermediate 

and Tarea = reading 

and reading skills S comprehension 

and achlevel = average 

and SES = middle class I upper class 

and DIR ge 0. 8 

then DIRval = medium <0. 8>. 

message "You are using an extremely high amount of direct instruc-" 

"tion, which is important nhen teaching basic skills.", 

"HoRever, nith intermediate students a more moderate amount 

"of direct instruction is appropriate.", 
tl tt 

display attach reference^ of kb. 
endif. 



DIR1 gb: 

if tlevel = intermediate 

and Tarea i reading | mathematics | language arts 

and Tgoal = tests 

and achlevel = average 

and SES = middle class I upper class 

and Dl'R ge 0. 8 

then DIRval = Medium <0. 8>. 

message "You are using an extremely high amount of direct instruc-" 

"tion, Khich is important when teaching basic skills.", 

"However, with intermediate students a more moderate amount 

"of direct instruction is appropriate.", 
tt tt 

display attach referenceH of kb. 
endif. 



DIRIh: 

if tlevel = primary 

and Tarea = language arts 

and language skills S writing 

and achlevel = average 

and SES = middle class I upper class 

and DIR ge 0. 8 

then DIRval = high <0. 8>. 

message "You are conducting a great deal of direct instruction in", 

"your classroom. This is a sound instructional practice. ", 

"The high amount of direct instruction is particularly", 

"important when basic skills are being taught.", 
tl tt 

display attach references of kb. 
display attach reference9 of kb. 
endif. 



nxRii: 

pni/^" if tlevel = intermediate O ^ r> 

££!!!febii . and Tarea = language arts ^1 O 



DIR1 j: 



DIRIk: 



and language skills IF Kriting 

and achlevel = average 

and SES = middle class I upper class 

and DIR ge 0. 8 

then DIRval = medium <0. 8>. 

message "You are using an extremely high amount of direct instruc-", 

"tion, Khich is important Khen teaching basic skills.", 

"HoKever, Kith intermediate students a more moderate amount", 

"of direct instruction is appropriate.", 
tt tt 

display attach referenced of kb. 
endif . 



if tlevel = primary 

and Tarea = reading 

and reading skills ^ comprehension 

and achlevel = average 

and SES = middle class I upper class 

and DIR ge 0. 8 

then DIRval = medium <0. 7>. 

message "You are providing an extremely high amount of direct", 

"instruction. Your amount of direct instruction is some-", 
"what too high Khen teaching higher level skills, including", 
"reading comprehension. Direct instruction of comprehension", 
"skills should be accompanied by adequate time for silent", 
"reading. ", 



display attach referenced of kb. 
display attach referencelS of kb. 
endif. 



if tlevel = intermediate 

and Tarea = reading 

and reading skills = comprehension 

and achlevel = average 

and SES - middle class I upper class 

and DIR ge 0. 8 

then DIRval = medium <0. 8>. 

message "You are providing an extremely high amount of direct", 

"instruction. Your amount of direct instruction is some-", 

"Rhat too high Rhen teaching higher level skills, including", 

"reading comprehension. Direct instruction of comprehension", 

"skills should be accompanied by adequate time for silent", 

"reading. ", 
tt tt 

display attach referenced of kb. 
display attach reference15 of kb. 
endif. 



DIR1L: 



ERLC 



if tlevel = primary 

and Tarea =^ language arts 

and language skills = Kriting 

and achlevel = average 

and SES = middle class I upper class 

and DIR ge 0. 8 

then DIRval = medium <0. 6>. 

message "You are providing an extremely high amount of direct", 

"instruction. Your amount of direct instruction is someKhat", 
"too high Khen teaching Rriting. Direct instruction of", 
"writing skills should be accompanied by adequate time for", 
"the practice of Kriting.", 

2 1 ,9 



display attach reference 10 oC kb. 
endif . 



DIR1m: 

if tlevel = intermediate 

and Tarea = language arts 

and language skills = nriting 

and achlevel = average 

and SES = middle class I upper class 

and DIR ge 0. 8 

then DIRval = low <0. 7>. 

message ••You are providing an extremely high amount of direct**, 

"instruction. Your amount of direct instruction is somenhat 

"too high Hhen teaching writing. Direct instruction of", 

"nriting skills should be accompanied by adequate time for", 

"the practice of writing. Intermediate students require a", 

"high amount of time for planning Khat they Kill write as we 

"as for writing. ", 
tt tl 

display attach referencelO of kb. 
endif. 



DIRIna: 

if 

tlevel = primary I intermediate 

and Tarea = reading 

and reading skills # comprehension 

and SES = poor 

and achlevel = low 

and DIR ge 0. 8 

then DIRval = high <0. 8>. 

message "You ar^ conducting a great deal of direct instruction in", 

"your classroom. This is a sound instructional practice.", 

"The high amount of direct instruction is particularly", 

"important when basic skills are being taught.", 
tt tt 

display attach references of kb. 
display attach reference9 of kb. 
endif. 

DIRInb: 

if 

tlevel = primary 1 intermediate 

and Tarea # reading | mathematics | language arts 

arid Tgoal = tests 

and SES = poor 

and achlevel = low 

and DIR ge 0. 8 

then DIRval = high <0. 8>. 

message "You are conducting a great deal of direct instruction in", 

"your classroom. This is a sound instructional practice.", 

"The high amount of direct instruction is particularly", 

"important when basic skills are being taught.", 
tl tt 

display attach references of kb. 
display attach reference9 of kb. 
endif. 



DIRIo: 



ERLC 



if 

tlevel = primary I intermediate 
and Tarea = reading 
and reading skills = comprehension 
and SES = poor 

and achlevel = low 220 



and OIR ge 0. 8 

then DIRval = high <0. 8>. 

message "You are conducting a great deal of direct in' ruction in", 

"your classroom. This is a sound instructio practice.", 

"Comprehension instruction Kith Iok achievement students", 

"should focus on direct instruction of comprehension", 

"strategies. 
tt tt 

display attach references of kb. 
endif . 

DIR1p: 

if 

tlevel = primary | intermediate 

and Tarea = language arts 

and language skills \i writing 

and SES = poor 

and achlevel = low 

and DIR ge 0. 8 

then DIRval = high <0. 8>. 

message "You are conducting a great deal of direct instruction in", 

"your classroom. This is a sound instructional practice. ", 
tt It 

display attach references of kb. 
display attach references of kb. 
endif. 

DIR1q: 

if 

tlevel = primary i intermediate 

and Tarea = language arts 

and language skills = writing 

and SES = poor 

and achlevel = low 

and DIR ge 0. 8 

then DIRval = low <0. 7>. 

message "You may help your students improve their writing by reducing", 

"the amount of direct instruction. They need more class time", 

"to develop writing skills through practice.", 
It tt 

display attach referencelO of kb. 
endif. 



DIRIra: 

if 

tlevel = primary | intermediate 

and Tarea = reading 

and reading skills \i comprehension 

and SES = middle class | upper class 

and achlevel = low 

and DIR ge 0. 8 

then DIRval = high <0. 6>. 

message "You are conducting a great deal of direct instruction in", 

"your classroom. This is a sound instructional practice.", 
tl It 

display attach references of kb. 
endif. 



DIRIrb: 

if 



tlevel = primary ' intermediate 
Q and Tarea reading I mathematics | language arts 

ERIC Tgoal = tests 

miiai^iijjij and SES = middle class | upper class 22J 



and achlevel = Iok 

and DIR ge 0. 8 

then DIRval = high <0. 6>. 

message "You are conducting a great deal of direct instruction m", 

"your classroom. This is a sound instructional practice.", 
tt It 

display attach references of kb. 
endif . 



DIR1s: 

if 

tlevel = primary 1 intermediate 

and Tarea = reading 

and reading skills = comprehension 

and SES = middle class ! upper class 

and achlevel = Ion 

and DIR ge 0. 8 

then DIRval = high <0. 6>. 

message "You are conducting a great deal of direct instruction in", 

"your classroom. This is a sound instructional practice.", 

"Comprehension instruction nith loH achievement students", 

"should focus on direct instruction of comprehension", 

"strategies. ", 
tt tt 

display attach references of kb. 
endif. 



DIR1 1: 

if 

tlevel = primary I intermediate 

and Tarea = language arts 

and language skills i\ nriting 

and SES = middle class | upper class 

and achlevel = Iok 

and DIR ge 0. 8 

then DIRval = high <0. 7>. 

message "You are conducting a great deal of direct instruction in", 

"your classroom. This is a sound instructional practice. ", 
tt It 

display attach references of kb. 
display attach references of kb. 
endif. 



DI R1 u: 

if 

tlevel = primary I intermediate 

and Tarea = language arts 

and language skills = Kriting 

and SES = middle class I upper class 

and achlevel = Iok 

and DIR ge 0. 8 

then DIRval = Iok <0. 6>. 

message "You may help your students improve their Kriting by reducing", 

"the amount of direct instruction. They need more class time", 

"to develop Kriting skills through practice.", 
tt It 

display attach referencelO of kb. 
endif. 



DIRIva: 



ERLC 



if 

tlevel = primary I intermediate 

and Tarea = reading 

and reading skills ft comprehension 

and SES = poor 222 



and achieve! = average 

and DIR ge 0. 8 

then DIRval high <0. 6>. 

message "You are conducting a great deal or direct instruction in", 

"your classroom. This is a sound instructional practice. ", 
II II 

display attach references of kb. 
endif. 



DIR1 vb: 

if 

tlevel = primary | intermediate 

and Tarea # reading I mathematics I language arts 

and Tgoal = tests 

and SES = poor 

and achlevel = average 

and DIR ge 0. 8 

then DIRval = high <0. 6>. 

message "You are conducting a great deal of direct instruction in", 

"your classroom. This is a sound instructional practice. ", 
II II 

display attach references of kb. 
endif. 



DIR1r: 



DIR1x: 



if 

tlevel = primary | intermediate 

and Tarea = reading 

and reading skills = comprehension 

and SES = poor 

and achlevel = average 

and DIR ge 0. 8 

then DIRval = medium <0. S>. 

message "Your amount of time for direct instruction is quite high. ", 

"For average achievement students it Kill be helpful to", 

"reduce direct instruction somenhat, aliening them more class", 

"time for silent reading. ", 
II II 

display attach references of kb. 
display attach referenced of kb. 
endif. 



if 

tlevel = primary | intermediate 

and Tarea = language arts 

and language skills W Kriting 

and SES = poor 

and achlevel = average 

and DIR ge 0. 8 

then DIRval = high <0. 6>. 

message "You are conducting a great deal of direct instruction in", 

"your classroom. This is a sound instructional practice. ", 
It II 

display attach references of kb. 
endif. 



DIRly: 



ERIC 



if 

tlevel = primary ! intermediate 

and Tarea = language arts 

and language skills = Kriting 

and SES = poor 

and achlevel = average 

and DIR ge 0. 8 

then DIRval = Iok <0. S>. 223 



message "\o\x may help your scuuencs improve caeir HriLing d> reuucina 

"the amount of direct instruction. They need more class time" 

"to develop writing skills through practice.", 
tt tt 

display attach referencelO of kb. 
endif . 



DIRIza: 

if 

tlevel = primary 

and Tarea = reading 

and reading skills ii comprehension 

and achlevel = high 

and DIR ge 0. 8 

then DIRval = high <0. 8>. 

message "You are conducting a great deal of direct instruction in", 

"your classroom. This is a sound instructional practice. ", 

"The high amount of direct instruction is particularly", 

"important Hhen basic skills are being taught.", 
tt tt 

display attach references of kb. 
display attach reference9 of kb. 
endif. 



DIRIzb: 

if 

tlevel = primary 

and Tarea = language arts 

and language skills # nriting 

and ^xchlevel = high 

and DIR ge 0. 8 

then DIRval = high <0. 8>. 

message "You are conducting a great deal of direct instruction in", 

"your cicssroom. This is a sound instructional practice.", 

"The high amount of direct instruction is particularly", 

"important when basic skills are being taught.", 
tt tt 

display attach references of kb. 
display attach reference9 of kb. 
endif. 



DIRIzc: 

if 

tlevel = primary 

and Tarea reading | mathematics I language arts 

and Tgoal = tests 

and achlevel = high 

and DIR ge 0. 8 

then DIRval = high <0. 8>. 

message "You are conducting a great deal of direct instruction in", 

"your classroom. This is a sound instructional practice.", 

"The high amount of direct instruction is particularly", 

"important Khen basic skills are being taught.", 
tt tt 

display attach references of kb. 
display attach reference9 of kb. 
endif. 



DIRIaa: 

if 

tlevel = intermediate 
and Tarea = reading 
and achlevel = high 
Q and DIR ge 0. 8 2? 4 

then DIRval = loH <0. 7>. ^ 

message "Your amount of direct instruction is very high. Reducing", 
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DIRIbb: 



"this amount to a low ievei snouid help lu^h aolucveincnL*\ 

"students in intermediate reading. They need more time to", 

"read. ", 
II 11 

display attach referencelO of kb. 
display attach reference15 of kb. 

endif . 



if 

tlevel = intermediate 

and Tarea = language arts 

and language skills # nriting 

and achlevel = high 

and DIR ge 0. 8 

then DIRval = high <0. 7>. 

message "You are conducting a great deal of direct instruction in", 

"your classroom. This is a sound instructional practice.", 

"The high amount of direct instruction is particularly", 

"important Hhen basic skills are being taught.", 
It tl 

display attach references of kb. 
display attach reference9 of kb. 
endif. 

DIRIcc: 

if 

tlevel = intermediate 

and Tarea = language arts 

and language skills = nriting 

and achlevel = high 

and DIR ge 0. 8 

then DIRval = loH <0. 7>. 

message "You are providing too much direct instruction when you teach 

"writing. Students require a lot more time in class for the" 

"practice of writing.", 
tt II 

display attach referencelO of kb. 
endif. 

\******medium dir starts here 

DIR1L12a: 
if 

tlevel = primary 

and Tarea = reading 

and reading skills \i comprehension 

and achlevel = high 

and DIR It 0. 8 

and DIR ge 0. 7 

then DIRval = medium <0. 8>. 

message "You are providing a moderate amount of direct instruction. ", 

"Increasing direct instruction somewhat should help to in-", 

*'crease your students* basic reading skills. 
II tl 

display attach referenced of kb. 
endif. 

DIR1L12b: 
if 

tlevel = primary 

and Tarea # reading ! mathematics I language arts 

^ and Tgoal = tests 

and achlevel = high 

and DIR It 0.8 
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and bLR ge 0. 7 

then DIRval = medium <0. 8>. 

message **You are providing a moderate amount of direct instruction. 

"Increasing direct instruction someKhat should help to in-" 
"crease your students* basic reading skills.", 

M II 

display attach referenced* of kb. 
endif. 



DIR1m13: 

if 

tlevel = primary 

and Tarea = language arts 

and language skills i\ Kriting 

?\nd achlevel = high 

and DIR It 0. 8 

and DIR ge 0. 7 

then DIRval = medium <0. 8>. 

message "You are providing a moderate amount of direct instruction. 

"Increasing direct instruction somewhat should help to m-" 

"crease your students* basic skills in language arts.", 
II tl 

display attach referenced* of kb, 
endif. 



DIR1n14a: 
if 

tlevel = intermediate 

and Tarea = reading 

and reading skills comprehension 

and achlevel = high 

and DIR It 0. 8 

and DIR ge 0. 7 

then DIRval = high <0. 8>. 

message "You are providing a moderate amount of direct instruction. 

"For high achievement students Horking on basic reading", 

"skills, this amount is a sound instructional practice.", 
II It 

display attach references of kb. 
endif. 



DIR1n1i*b: 
if 

tlevel = intermediate 

and Tarea H reading | mathematics I language arts 

and Tgoal = tests 

and achlevel = high 

and DIR It 0. 8 

and DIR ge 0. 7 

then DIRval = high <0. 8>. 

message "You are providing a moderate amount of direct instruction. 

"For high achievement students Korkmg on basic reading", 

"skills, this amount is a sound instructional practice. ", 
II tl 

display attach references of kb. 
endif. 



DIRIolS: 
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if 

tlevel = intermediate 
and Tarea = language arts 
and language skills # writing 
and achlevel = high 
and DIR It 0. 8 

and DIR ge 0.7 2^6 



then DIRvai - high <0. •d>. 

message "You are providing a moderate amount of direct instruction. 

"For high achievement students working on language basic", 
"skills, this amount is a sound instructional practice. ". 

display attach references of kb, 

endif . 

DIRIplba: 
if 

tlevel = primary 

and Tarea = reading 

and reading skills i\ comprehension 

and achlevel = Ion I average 

and DIR It 0. 8 

and DIR ge 0. 7 

then DIRval = medium <0. 8>. 

message "You are providing a moderate amount of direct instruction. " 

"For lOH and average achievement primary students working on 

"basic skills, increasing their direct instruction somewhat" 

"may produce higher achievement. ", 
tt It 

display attach referenced of kb. 
endif. 



DIRIpIbb: 
if 

tlevel = primary 

and Tarea ii reading | mathematics | language arts 

and Tgoal = tests 

and achlevel = low I average 

and DIR It 0. 8 

and DIR ge 0. 7 

then DIRval = medium <0. 8>. 

message "You are providing a moderate amount of direct instruction. " 

"For low and average achievement primary students working on 

"basic skills, increasing their direct instruction somewhat" 

"may produce higher achievement. ", 
tl tt 

display attach referenced* of kb. 
endif. 



DIR1 q1 7: 

if 

tlevel = primary 

and Tarea = language arts 

and language skills i\ writing 

and achlevel = low I average 

and DIR It 0. 8 

and DIR ge 0. 7 

then DIRval = medium <0. 8>. 

message "You are providing a moderate amount of direct instruction. " 

"For loK and average achievem^-nt primary students working on 

"basic skills, increasing their direct instruction somewhat" 

"may produce higher achievement.", 
II II 

display attach referenced of kb. 
endif. 



DIR1rl8: 
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if 

tlevel = intermediate 
and Tarea = language arts 
and language skills # writing 
or Tgoal = tests 

and achlevel = low 2/?V 



and OIR Ic 0. 

and DIR ge 0. 7 

then DIRval = medium <0. 8>. 

message "You are providing a moderate amount of direct instruction. 

"To improve language basic skills, your low achievement", 

"students should have someKhat more direct instruction.", 
tl tt 

display attach references of kb. 
endif . 



DIRls19a: 
if 

tlevel = intermediate 

and Tarea = reading 

and reading skills # comprehension 

and achlevel = Ion 

and DIR It 0. 8 

and DIR ge 0. 7 

then DIRval = medium <0. 8>. 

message "You are providing a moderate amount of direct instruction. 
"To improve basic reading skills, your Iok achievement", 
"students should have somenhat more direct instruction. 

display attach references of kb. 

endif. 

DIRls19b: 
if 

tlevel = intermediate 

and Tarea # reading | mathematics I language arts 

and Tgoal = tests 

and achlevel = Iok 

and DIR It 0. 8 

and DIR ge 0. 7 

then DIRval = medium <0. 8>. 

message "You are providing a moderate amount of direct instruction. 
"To improve basic reading skills, your Iok achievement", 
"students should have someKhat more direct instruction, ", 

display attach references of kb, 

endif. 



DIR1 120: 

if 

tlevel = intermediate 

and Tarea = language arts 

and language skills nriting 

and achlevel =: average 

and SES = poor 

and DIR It 0. 8 

and DIR c** 0- 7 

then DIRval = medium <0. 8>. 

message "You are providing a moderate amount of direct instruction. 

"To improve basic skills in language arts, your students", 

"should have someKhat more direct instruction.'*. 
It II 

display attach references of kb. 
endif. 



DIR1u21a: 
if 



tlevel = intermediate 
and Tarea = reading 
and reading skills \\ comprehension 
and achlevel = average 
and SES = middle class I upper class 
and DIR It 0. 8 



CDir" ana DIR It 0. B 

and DIR ge 0.7 2^8 



then DIUval = high <U. o>. 

message "You are providing a moderate amount of direct instruction. 
"This amount is a sound instructional practice for your", 
"students. ", 

It H 

display attach reference15 of kb. 
endif . 

DIR1u21b: 
if 

tlevel ~ intermediate 

and Tarea reading ! mathematics I language arts 

and Tgoal = tests 

and achlevel = average 

and SES = middle class I upper class 

and DIR It 0. 8 

and DIR ge 0. 7 

then DIRval = high <0. 8>. 

message "You are providing a moderate amount of direct instruction. 

"This amount is a sound instructional practice for your", 

"students. ", 
tt tt 

display attach reference15 of kb. 
endif. 



DIR1v22a: 
if 

tlevel = intermediate 

and Tarea = reading 

and reading skills \i comprehension 

and achlevel - average 

and SES = poor 

and DIR It 0. 8 

and DIR ge 0. 7 

then DIRval = medium <0. 8>. 

message "You are providing a moderate amount of direct instruction. 

"To improve basic reading skills, your students should have 

"somewhat more direct instruction.". 
It tt 

display attach references of kb. 
endif. 



DIR1v22b: 
if 

tlevel = intermediate 

and Tarea 4^ reading I mathematics I language arts 

and Tgoal = tests 

and achlevel = average 

and SES = poor 

and DIR It 0. 8 

and DIR ge 0. 7 

then DIRval = medium <0. 8>. 

message "You are providing a moderate amount of direct instruction. 

"To improve basic reading skills, your students should have 

"somewhat more direct instruction.", 
tt tt 

display attach references of kb. 
endif. 



DIR1H23: 
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if 

tlevel = intermediate 

and Tarea = language arts 

and language skills \i writing 

and achlevel = average 

and SES = middle class I upper class 



and uiH it V. o 
and OIR ge 0. 7 
then DIRval = high <0. 8>. 
message "You are providing a moderate amount of direct instruction. 

"This amount is a sound instructional practice for your", 

"students. 

M II 

display attach reference15 of kb. 
endif. 



DIR1x24a: 

if tlevel = primary 1 intermediate 

and Tarea = reading 

and reading skills = comprehension 

and achlevel = high 

and DIR It 0.8 

and DIR ge 0. 7 

then DIRval = medium <0. 8>. 

message "You are providing a moderate amount of direct instruction. 

"Reducing direct instruction somenhat should improve your", 

"students' comprehension and/or nriting performance. Your" 

"students require adequate time for independent seatKork. ", 
11 II 

display attach referencelO of kb. 
endif. 



DIR1x24b: 

if tlevel = primary I intermediate 

and Tarea = language arts 

and language skills = nriting 

and achlevel = high 

and DIR It 0. 8 

and DIR ge 0. 7 

then DIRval = medium <0. 8>. 

message "You are providing a moderate amount of direct instruction. 

"Reducing direct instruction someKhat should improve your"> 

"students* comprehension and/or Kriting performance. Your" 

"students require adequate time for independent seatKork. ", 
II II 

display attach referencelO of kb. 
endif. 



DIR1y25a: 

if tlevel = primary 

and Tarea - reading 

and reading skills = comprehension 

and achlevel = average 

and SES = middle class | upper class 

and DIR It 0. 8 

and DIR ge 0. 7 

then DIRval = medium <0. 7>. 

message "You are providing a moderate amount of direct instruction. 

"Reducing direct instruction somewhat should improve your", 

"students* comprehension and/or writing performance. Your" 

"students require adequate time for independent seatwork. ", 
II II 

display attach referencelO of kb. 
endif. 




DIR1y25b: 

if tlevel = primary 
and Tarea = language arts 
and language skills =: writing 
and achlevel = average 
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anu UXK ic u. o 
and DIR ge 0. 7 
then DIRval = medium <0. 7>. 

message ''You are providing a moderate amount of direct instruction. " 

"Reducing direct instruction somewhat should improve your", 

"students* comprehension and/or writing performance. Your", 

"students require adequate time for independent seatwork. ", 
tt tt 

display attach referencelO of kb. 
endif . 



DIR1z26a: 



if 

tlevel = primary I intermediate 
and Tarea = reading 
and reading skills = comprehension 
and SES = poor 

and achlevel = Ioh ! average 

and DIR It 0. 8 

and DIR ge 0. 7 

then DIRval = high <0. 7>. 

message "You are providing a moderate amount of direct instruction.", 

"Hith your students this amount is a sound instructional", 

"practice. ", 
ft tf 

display attach references of kb. 
endif. 



DIR1z26b: 



if 

tlevel = primary [ intermediate 
and Tarea = language arts 
and language skills = nriting 
and SES = poor 

and achlevel = Iok I average 

and DIR It 0. 8 

and DIR ge 0. 7 

then DIRval = high <0. 7>. 

message "You are providing a moderate amount of direct instruction.", 

"Hith your students this amount is a sound instructional", 

"practice. ", 
tt tt 

display attach references of kb 
endif. 



DIR1aa27: 



if 

tlevel = intermediate 

and Tarea = reading 

and reading skills = comprehension 

and SES = middle class | upper class 

and achlevel = average 

and DIR It 0. 8 

and DIR ge 0. 7 

then DIRval = medium <0. 6>. 

message "You are providing a moderate amount of direct instruction.", 
•'Reducing direct instruction somewhat should improve your", 
"students* reading comprehension. They need adequate time", 
"for silent reading.", 
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display attach referencelO of kb. 
endif. 
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if 

tlevel = intermediate 

and Tarea = reading 

and reading skills ^ comprehension 

and SES = poor 

and achlevel = average 

and DIR It 0. 8 

and DIR ge 0. 7 

then DIRval = high <0. &>. 

message "You are providing a moderate amount of direct instruction.", 
"Hith your students this amount is a sound instructional", 
"practice. ", 

n tt 

display attach references of kb. 
endif . 



DIR1CC29: 
if 

tlevel = intermediate 

and Tarea = language arts 

and language skills = nriting 

and SES = middle class \ upper class 

and achlevel = average 

and DIR It 0. 8 

and DIR ge 0. 7 

then DIRval = low <0. 6>. 

message "You are providing a moderate amount of direct instruction. ", 

"Your students should benefit from a reduction of direct", 

"instruction. They need adequate timo for practicing writing.". 
It tt 

display attach referencelO of kb. 
endif. 

DIR1dd30: 
if 

tlevel = intermediate 

and Tarea = language arts 

and language skills = writing 

and SES = poor 

and achlevel average 

and DIR It 0. 8 

and DIR ge 0. 7 

then DIRval = medium <0. &>. 

message "You are providing a moderate amount of direct instruction.", 

"Reducing direct instruction somewhat should improve your", 

"students* writing performance. They need adequate time for", 

"practicing writing.", 
II It 

display attach referencelO of kb. 
endif. 



DIR1ee31a: 
if 

tlevel = primary 1 intermediate 

and Tarea = reading 

and reading skills = comprehension 

and SES = middle class I upper class 

and achlevel = low 

and DIR It 0. 8 

and DIR ge 0. 7 

then DIRval = high <0. 7>. 

message "You are providing a moderate amount of direct instruction. 
Q "Hith your students thift amount is a sound instructional", 

"practice. ", 
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display attach i^eret^enoe^ ot ku, 
endif . 



0IR1ee31b: 
if 

tlevel = primary | intermediate 

and Tarea = language arts 

and language skills = Kriting 

and SES = middle class I upper class 

and achlevel = Iok 

and DIR It 0.8 

and DIR ge 0. 7 

then DIRval = high <0. 7>. 

message "You are providing a moderate amount of direct instruction. " 

"Hith your students this amount is a sound instructional*', 

"practice. ", 
tl It 

display attach references of kb. 
endif. 



\Aiiii:^AiiAiiA:k:k:k:kA:k:klQ^ djr language arts and reading starts here 

DIR1ff32aa: 
if 

tlevel = primary | intermediate 

and Tarea = reading 

and reading skills 1( comprehension 

and achlevel = Iok 

and DIR It 0. 7 

and DIR ge 0. 5 

then DIRval = Iok <0. 8>. 

message "You are providing a relatively Iok amount of direct instruc 

"tion. HoKever, in basic skills instruction your students", 

"should receive a high amount of direct instruction. ", 
It It 

display attach reference9 of kb. 
display attach reference14 of kb. 
endif. 



DIR1ff32ab: 
if 

tlevel = primary I intermediate 

and Tarea # reading | mathematics | language arts 

and Tgoal = tests 

and achlevel = Iok 

and DIR It 0. 7 

and DIR ge 0. 5 

then DIRval = Iok <0. 8>. 

message "You are providing a relatively Iok amount of direct instruc 

"tion. HoKever, in basic skills instruction your students", 

"should receive a high amount of direct instruction.", 
II II 

display attach reference9 of kb. 
display attach referenced of kb. 
endif. 



DIR1ff32ba: 
if 

^ tlevel = primary | intermediate 

gj^Q and Taroa = language arts 
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anu aclilevel - loh 

and DIR It 0. 7 

and DIR ge 0. 5 

then DIRval = lOK <0. 3>. 

message "You are providing a relatively loK amount of direct mstruc 

"tion. Honever, in basic skills instruction your students", 

"should receive a high amount of direct instruction.", 
•t It 

display attach reference9 of kb. 
display attach reference14 of kb. 
endif . 



DIR1ff32bb: 
if 

tlevei = primary | intermediate 

and Tarea # reading | mathematics I language arts 

and Tgoal = tests 

and achlevel = loH 

and DIR It 0. 7 

and DIR ge 0. 5 

then DIRval = low <0. 8>. 

message "^ou are providing a relatively loK amount of direct instruc 

"tion. Honever, in basic skills instruction your students", 

"should receive a high amount of direct instruction. 
tt tt 

display attach reference9 of kb. 
display attach reference14 of kb. 
endif. 



DIR1gg33aa: 
if 

tlevei = primary | intermediate 

and Tarea = reading 

and reading skills # comprehension 

and SES = middle class | upper class 

and achlevel = average I high 

and DIR It 0. 7 

and DIR ge 0. 5 

then DIRval = medium <0. 7>. 

message "You are providing a relatively low amount of direct instruc 

"tion. However, when basic skills are being taught, your", 

"students will benefit from a higher amount of direct", 

"instruction. 
tt tt 

display attach reference9 of kb. 
display attach referenced of kb. 
endif. 



DIR1gg33ab: 
if 
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tlevei = primary | intermediate 

and Tarea reading | mathematics I language arts 
and Tgoal = tests 

and SES = middle class | upper class 

and achlevel = average | high 

and DIR It 0. 7 

and DIR ge 0. 5 

then DIRval = medium <0. 7>. 

message "You are providing a relatively low amount of direct instruc 
"tion. However, when basic skills are being taught, your", 
"students will benefit from a higher amount of direct", 
"instruction. ", 
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display attach reference9 of kb. 
display attach reference14 of kb. 
endif . 



DIR1gg33ba: 
if 

tlevel = primary | intermediate 

and Tarea = language arts 

and language skills # writing 

and SES = middle class | upper class 

and achlevel = average | high 

and DIR It 0.7 

and DIR ge 0. 5 

then DIRval = medium <0. 7>. 

message "You are providing a relatively low amount of direct instruc 

"tion. However, when basic skills are being taught, your", 

"students Rill benefit from a higher amount of direct", 

"instruction. 
tt t« 

display attach reference9 of kb. 
display attach reference!** of kb. 
endif. 

DIR1gg33bb: 
if 

tlevel = primary I intermediate 

and Tarea $ reading | mathematics | language arts 
and Tgoal = tests 

and SES = middle class | upper class 

and achlevel = average | high 

and DIR It 0.? 

and DIR ge 0. 5 

then DIRval = medium <0. 7>. 

message "You are providing a relatively low amount of direct instruc 

"tion. However, when basic skills are being taught, your", 

"students will benefit from a higher amount of diract", 

"instruction. ", 
tl tt 

display attach reference9 of kb. 
display attach referenced of kb. 
endif. 



DIR1hh3Haa: 
if 

tlevel = primary | intermediate 
and Tarea = reading 
and reading skills \i comprehension 
and SES = poor 

and achlevel = average | high 

and DIR It 0. ? 

and DIR ge 0. 5 

then DIRval = medium <0. 6>. 

message "You are providing a relatively low amount of direct instruc 

"tion. Your students may have higher performance in basic", 

"skills if you increase direct instruction.", 
tt tl 

display attach reference9 of kb. 
display attach referenced of kb. 
endif. 



tievel = primary i mcermeuiace 
and Tgoal = tests 

and Tarea $ reading I mathematics I language arts 
and SES = poor 

and achlevel = average ! high 

and DIR It 0.7 

and DIR ge 0. 5 

then DIRval = medium <0. 6>. 

message "You are providing a relatively Ior amount of direct instruc 

"tion. Your students may have higher performance in basic", 

"skills if you increase direct instruction. *\ 
ti It 

display attach reference9 of kb. 
display attach referenced of kb. 
endif . 



DIR1hh34ba: 
if 

tievel = primary | intermediate 
and Tarea = language arts 
and language skills # nriting 
and SES = poor 

and achlevel = average | high 

and DIR It 0. 7 

and DIR ge 0. 5 

then DIRval = medium <0. 6>. 

message "You are providing a relatively Ion amount of direct instruc 

"tion. Your students may have higher performance in basic", 

"skills if you increase ' direct instruction.", 
tt tt 

display attach reference9 of kb. 
display attach referenced of kb. 
endif. 
DIR1hh3iJbb: 
if 

tievel = primary I intermediate 
and Tgoal = tests 

and Tarea # reading | mathematics I language arts 
and SES = poor 

and achlevel = average I high 

and DIR .t 0. 7 

and DIR ge 0. 5 

then DIRval = medium <0. 6>. 

message "You are providing a relatively Iok amount of direct instruc 

"tion. Your students may have higher performance in basic", 

"skills if' you increase direct instruction.", 
tt tt 

display attach reference9 of kb. 
display attach referenced of kb. 
endif. 



DIR1ii35: 
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if 

tievel = primary 

and Tarea = reading 

and reading skills = comprehension 

and achlevel = Iok 

and DIR ge 0. 5 

and DIR It 0. 7 

then DIRval = Iok <0. 5>. 

message "You are providing a relatively Iok amount of direct instruc 
"tion. Lor achievement stuaents require more direct instruc 
"tion. Teaching them specific comprehension strategies Kill 
"help them improve reading comprehension. ", 
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display attach ret'erencej of kD. 
display attach ref erencel 4 ^of kb 
endif. 



DIR1 jj36: 
if 

tlevel = intermediate 

and Tarea = reading 

and reading skills = comprehension 

and SES = poor 

and achlevel = loH ! average 

and DIR ge 0. 5 

and DIR It 0. 7 

then DIRval = medium <0. 5>. 

message "You are providing a relatively Iok amount of direct instruc- 

"tion. Your students may require somenhat more direct", 

"instruction. Teaching them specific comprehension" > 

"strategies Hhile also providing time for silent reading"> 

"Hill help them improve reading comprehension. "> 
II II 

display attach references of kb. 
display attach referenced of kb. 
endif. 



DIR1 kk37: 
if 

tlevel = primary I intermediate 

and Tarea = language arts 

and language skills = nriting 

and achlevel = loH 

and DIR ge 0. 5 

and DIR It 0. 7 

then DIRval = medium <0. 9>. 

message "You are providing a relatively loH amount of direct instruc- 

"tion. Though your students require adequate class time for" 

"the practice of nriting, they also need direct instruction"^ 

"in nriting skills. ", 
i> i> 

display attach referenced* of kb. 
endif. 



DIR1LL38aa: 
if 

tlevel = primary I intermediate 

and Tarea = reading 

and reading skills = comprehension 

and SES = middle class | upper class 

and achlevel = average I high 

and DIR ge 0. 5 

and DIR It 0. 7 

then DIRval = high <0. 8>. 

message "You are providing a relatively Iok amount of direct instruc- 

"tion> Hhich is a sound instructional practice for your stu-" 

"dents. They need adequate class time for the reading and/or 

"Kriting. "> 
II »i 

display attach referencelO of kb. 
endif. 



DIR1LL38ab: 
if 
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tlevel = primary I intermediate 
and Tgoal = tests 

and Tarea reading | mathematics I language arts 
and SES = middle class I upper class 
and achlevel = average I high 



and ULR ge u. 5 
and DIR It 0.7 
then DIRval = high <0. 8>. 

message "You are providing a relatively low amount of direct mstruc-", 

"tion, Khich is a sound instructional practice for your stu-", 

"dents. They need adequate class time for the reading and/or", 

"nriting. 
It It 

display attach referencelO of kb. 
endif . 

DIR1LL38ba: 
if 

tlevel = primary j intermediate 

and Tarea = language arts 

and language skills i\ nriting 

and SES = middle class ! upper class 

and achlevel = average 1 high 

and DIR ge 0. 5 

and DIR It 0.7 

then DIRval = high <0. 8>. 

message "You are providing a relatively Iok amount of direct instruc-'*, 
"tion, Khich is a sound instructional practice for your stu-", 
"dents. They need adequate class time for the reading and/or", 
"Kriting. 

tt n 

display attach referencelO of kb. 
endif. 

DIR1LL38bb: 
if 

tlevel = primary j intermediate 
and Tgoal = tests 

and Tarea # reading ! mathematics | language arts 

and SES = middle class ! upper class 

and achlevel = average 1 high 

and DIR ge 0. 5 

and DIR It 0.7 

then DIRval = high <0. 8>. 

message "You are providing a relatively Iok amount of direct instruc-", 

"tion, Khich is a sound instructional pr?ntice for your stu-", 

"dents. They need adequate class time for the reading and/or", 

"writing. ", 
ft II 

display attach referencelO of kb. 
endif. 



DIR1mm39: 
if 
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tlevel = intermediate 

and Tarea = reading 

and reading skills = comprehension 

and SES = middle class ! upper class 

and achlevel = low 

and DIR £e 0. 5 

and DIR It 0.7 

then DIRval = aedium <0. 7>. 

message "You are providing a relatively low amount of direct instruc-", 
"tion. Though your students require adequate class time for", 
"silent reading, they also need direct instruction in compre-", 
"hension skills. 



display attach referenced of kb. 
endif. 
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if tlevel = intermediate 1 primary 

and Tarea = reading 

and reading skills = comprehension 

and SES = poor 

and achlevel = high 

and DIR ge 0. 5 

and DIR It 0. 7 

then DIRval = high <0. 8>. 

message "You are providing a relatively Iok amount of direct instruc- 

"tion, which is a sound instructional practice for your stu-" 

"dents. They need adequate class time for the reading and/or 

"writing. ", 
tl It 

display attach referencelO of kb. 
endif. 



DIR1nn40b: 

if tlevel = intermediate 1 primary 

and Tarea = language arts 

and language skills = writing 

and SES = poor 

and achlevel = high 

and DIR ge 0. 5 

and DIR It 0. 7 

then DIRval = high <0. 8>. 

message "You are providing a relatively loH amount of direct instruc- 

"tion, which is a sound instructional practice for your stu-" 

"dents. They need adequate class time for the reading and/or 

"writing. "> 
It It 

display attach referencelO of kb. 
endif. 



speddir: 

if Tarea = special education 
then 

message "This system was developed for regular education", 
"teachers whose classrooms include mainstreamed special education", 
"students. You probably will not find the questions or the", 
"recommendations appropriate for you. If you would like to", 
"continue using the SNAP system, you will have to begin again", 
"and use one of the other subject areas when you are asked for", 
"this information.", 
endif. 



DIRa: 

if DIRval = high 
then DIRprob = none, 
endif. 



DIRb: 

if DIRval = medium 

and achlevel = average 1 high 

then DIRprob = none. 

endif. 



DIRc: 

if DIRval = medium 
and achlevel = low 
and tlevel = primary ' inter.'nediate 
Q and DIR ge 0. 8 

gl^l^" then DIRprob = high. 2-^9 



DiRe: 

if DIRval = medium 

and achlevel = Ioh 

and tlevel = primary I intermediate 

and DIR It 0.7 

then DIRprob = low. 

endif . 



DIRg: 



if DIRval = loK 
and DIR ge 0. 7 
then DIRprob = high, 
endif. 



DIRh: 



if DIRval = low 
and tlevel = primary 
and DIR It 0.7 
then DIRprob = low. 
endif. 



intermediate 



actions: 



message 



break, 
message 



Helcome 
to the 

Teacher Effectiveness Planner 



Th 

"the syste 
"teacher e 
"included 
"and quest 
"your clas 
"interpret 
"asked to 



is system Kill help 
m should recommend f 
ff ecti veness. Three 
in the present syste 
ioning. The system 
sroom, your school, 
ation of your studen 
enter data from the 



to determine Khat types of training options", 
or you based upon the research literature on " 

areas of teaching practice have been ", 
m: academic learning time, direct instruction 
Hill ask you questions about your students,", 

your common teaching practices, and your", 
ts' learning needs. In addition, you Kill be" 
self observations you have already completed. 



" For some of the questions, the answers are very specific, such as " 

" ' What grade do you teach?* For other questions, the answers will require" 
"some serious though*: on your part. For example, one of the questions you" 
"may be asked is • Hhat is your most important teaching goal?*. Hhile we ", 
"understand that teachers almost always have more than one goal in mind for 
"any single teaching activity, the system is not yet sophisticated enough " 
"to consider all the complexity that goes into teaching. He ask that you", 
'Vtr^v to determine, to the best of your ability, the best answer to the", 
"jstion that most accurately describes you as a teacher. ". 



break* 



message 



You have already been given some brief instructions about using the*\ 

SNAP system on the computer, but in case you need a fen reminders, here are", 

a fen things you should remember: 
ti 

1. Rhenever you see 'ready for command*, you can do one of", 
the follOKing: type 'continue', type 'explain' ", 

if you Hould like an explanation of the question or one of the ", 
ansner choices, or type 'freeze <your name>' to stop the SNAP ", 
system and allow yDu to return to it at a later time.", 

tt 

2. If you are asked a questions that alloKS you to choose more ", 
than one answer, connect your choices Kith the ' &' symbol.", 

tt 

3. li^ you do not knoK an ansner and cannot figure out an ansner", 
that makes sense, you may enter ' unknoKn' for any question,", 
but this Kill result in poor response by the computer system.". 
You Kill be better off simply choosing one of the possible ", 
ansKer choices given to you. ", 



break. 



message " The SNAP system Kill noK use the part of its knoKledge base", 
"on teacher effectiveness that deals Kith the amount of direct", 
"instruction provided in a classroom. The information used to ", 
"determine Khether you are providing the amount of direct instruction", 
"that research Kould indicate is good for your situation Kill come", 
"from data that you enter from Observation 1 (giving amounts of time", 
"that the students Kere in your classroom and amounts of time that", 
"you Kere teaching them), from additional questions that the ", 
"computer Kill ask you, and from draKing inferences from this data. ", 

tt tt 

It n 

t 

It It 

t 

It 

t 

tt 

break. 

message "First the system Kill determine the amount of time that is allocated", 

"for instruction on an average school day. ". 
obtain alloctm. 

message "The amount of allocated time (in minutes) on an average day is: ". 

display value of alloctm. 

break. 

message "Hok the system Kill determine the amount of time that is spent in", 

"providing direct instruction to students in your classroom.", 
obtain teachtm. 

message "The amount of teaching time (in minutes) on an average day is:". 

display value of taachtm. 

break. 

message "Nok the system Kill determine hOK Kell your direct instruction ratio", 

"(DIR* m-itches Khat Kould be suggested as ideal by researchers.", 
obtain DIR. 

message "Your Direct Instruction Ratio ( DIR) is: ". 
^--Dlay value of DIR. 

sage "This is the ratio of teaching time to allocated time. ". 
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obtain DIRval 



message "The amount of direct instruction you provide in your classroom is" 

display value of DIRval . 

break. 

message "If you would like to see the rule that the system used to evaluate 
"your Direct Instruction Ratio, type JUSTIFY DIRval". 

break. 

obtain DIRprob. 

message "Your training needs related to direct instruction are as follows: 
display value of DIRprob. 

message "You can interpret these as follows: ", 
" 'none' means that you have no particular training needs ", 
" related to direct instruction; ", 

" 'high' means that you are using too much direct instruction; ", 
"''low' means that you are not providing enough direct instruction" 

write "a:dir. dta", DIR, DIRval, DIRprob. 

break. 



message "You are now finished with this section of the SNAP system. To", 

"go on to the next section, you will have to exit from this part of the ", 
" SNAP system by typing 'stop'. Then, when you have the C prompt, ", 
"type 'kesr altkb. pkb'". 



break. 

% 



P> type^secdir 
\snapKb 



text: 

{certification: "This knoKledge base determines training", 
"needs related to the teacher effectiveness literature", 
"on academic learning time, questioning skill, and direct", 
"instruction. It Ras nritten in 1985 by Jackie Haynes and", 
"revised and enlarged by Jackie Haynes and Jennie Pilato", 
"in January, 1986. "} 

{certainties: "Certainty factors Here determined by following", 
"the follOHins rules: If a substantial piece of research Has", 
"used to write a rule and all elements embodied in the resarch", 
"are contained in the rule, the certainty factor assigned is 1.0.", 
"If the rule was derived from another rule with a certainty factor", 
"of 1.0 by changing one attribute, the certainty factor is reduced", 
"by 0.1. For each additional change to the original rule, another", 
"0. 1 is subtracted from the certainty factor for that rule. It is", 
"therefore possible to determine how far removed a rule is from the", 
"original research upon which it was based by examining its", 
"certainty factor. "} 



{ref erencel : 
{ref erence2: 
{references: 
{ref erenceU: 
{references: 
{ref erenceb: 
{reference?: 

{references: 
{ref erence9: 
{referencel 0 
{ref erencel 1 
{referencel 2 
{referencel 3 
{referencel 4 
{referencel 5 
{referencel 6 
{referencel 7 



•Anderson & Scott, 1978"} 
•Brophy, 1983"} 
•Brophy & Good, 1986"} 
•Centra & Potter, 1980"} 
•Emans, 1983"} 
•Evertson, 1980"} 

'Fisher, Berliner, Filby, Marliave, Cahen, & Dishaw", 
•1978"} 

•Good & GrouKs, 1979"} 
•Medley &, Crook, 1980"} 
•Peterson, 1979"} 

•Bieth, Polsgrove, & Semmel, 1981"} 

'Rosenshine, 1980"} 

•Rosenshine, 1983**} 

'Rosenshine, 1986"} 

•Souster, 1982"} 

'Stallings, 1976"} 

'Stallings & Kaskowitz, 1974"} 



attributes: 



alloctm: real 

(constraint: alloctm ge 0.0 and alloctm le 600.0) 
{explain: "Allocated time is the total amount of time that COULD", 
"be used for instruction. It excludes time used for recess, lunch,", 
"school playsi transition from one class to another, etc. "} 
{definition: "The amount of time students are in their classroom in a", 
"given school day"}. 



teachtm: real 

(constraint: teachtm ge 0.0 and teachtm le 600.01 
{definition: "Teaching time is the amount of time ? teacher", 
" spends providing direct instruction to the entire", 
"class or a subgroup of the class in a given school day."}. 

FR?r^ real 

^£>^ (constraint: DIR ge 0 and DIR le 1.0] 04 Q 



{definition: "the proportion of time available for direct", 
" instruction that is actually used for that purpose"}. 



DIRval: mlt 

(high, medium, Ior) 

(definition: "the evaluation of the teacher's reported data on", 

"the amount of direct instruction provided in the classroom, ", 
"considering other variables that affect Hhat this value", 
"should be"}. 

SES: sgl 

(poor, middle class, upper class) 

(question: "Hhat is the socio-economic status of your students?"} 
(definition: "the general socio-economic status of the majority of", 
" the students in a given classroom"}. 

Tarea: mlt 

( mathematics, 
English 

(question: "English (including study skills and reading)"}, 

reading (question: "reading (at the elementary level)"}, 

language arts, 

science, 

social studies, 

art, 

music, 

physical education, 
home economics, 
foreign language, 
health educaticti^ 
industrial arts, 

special education (explain: "Special Education, any grade level"}, 
other) 

(question: "Hhat subject do you teach?"} 

(definition: "specific skill and/or content areas you teach, or," , 
"if you are a generalist, any areas that you ", 
"specialize in"}. 

science^ focus: sgl 

( labs, lecture 

(question: "lecture and demonstration"}, 
discussion) 

(question: "Hhat form of instruction in science is most like ", 
"what you Here doing during the self observations?"}. 

Tlevel: sgl 

( primary 

(question: "Kindergarten thru Grade 3"}, 
intermediate 

(question: "Grades 4 thru 6"}, 
junior high 

(question: "Any grade in a school including grades 6 thru 9"}, 
hi^h school 

(question: "Any grade in a school including 9 thru 12"}) 
{question: "Hhat level do you teach?"} 

{definition: "The level at Khich you are assigned (not the", 
"instructional level of your students) to teach most of", 
"the time. "}. 

Tgoal: sgl 

(tests (question: "improving achievement as reflected in", 
" standardized test scores"}, 
^ self concept (question: "enhancing students' self concept"), 

school attitude (question: "improving students attitudes", 
tOHard school"}. 
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and problem solving")) 
{question: "Hhat is your most important teaching goal?"). 

achlevel: mlt 

(high, average, low) 

{question: "Hhat is the achievement level of most of your students?") 
{definition: "The achievement level of your students relative to", 
" national norms on achievement tests."). 



reading skills: mlt 

< beginnning rdg 

{question: "beginning reading skills (decoding, phonics,", 
" letter recognition)"), 

basic skills 

(question: " basic skills in reading (phonics, syllabication, ", 
"prefixes & suffixes, root words, etc.)"), 

vocabulary 

{question: "learning to recognize, use, and/or spoil new words "}> 
comprehension 

{question: "developinn the ability to understand text at lite»-al,", 
"inferential, and problem solving levels")) 

{question: "Rhat reading skills were you teaching during the", 
"time you were conducting the self observation ?">. 

language skills: mlt 

(oral expression 

{question: "oral expression (giving oral reports, speeches, etc.)"), 
grammar 

{question: "grammar (subject-verb agreement, parts of speech,", 
"types of sentences, correct usage, etc.)"), 
language mechanics 

{question: "mechanics of written language (capitalization,", 
" punctuation, etc. "), 

writing 

{question: "writing, including creative and expository writing")) 
{question: "Hhat language arts skills were you teaching during the", 
"time you were conducting the self observation?"). 

DIRprob: sgl 

(none, high, lokO 

{explain: "DIRprob means there is a problem with DIR, and thr/', 
"value high or low indicates the direction of the", 
"problem. "}. 



externals: 

allocatedtime: 

I program: "timal") 
C outputs: alloctm] 
C outputf ile: "timal. dta") . 

teachingtime: 

C program: "timtc"] 
C outputs: teachtmJ 
C outputf ile: "timtc. dta"l. 



rules: 



DIRothertj: 



if 

pp9p" Tlevel = junior high \ high school 2^5 
t^tyy and Tgoal # tests ^ 



I foreign language 

and DIR It 0.5 
and DIR ge 0. 33 
then 

DIRval = high <0. 6> . 

message "If you are trying to improve yonr students' creativity", 
"problem solving skills, attitude toward school, or self concept,", 
"you are giving them some direct instruction, which is essential,", 
"but you are also doing lots of other types of activities which are 
"better than direct instruction for promoting your major goals.", 
endif. 



DIRotherS: 
if 

Tlevel = junior high I high school 
and Tgoal ft tests 

and Tarea = mathematics I English | science I social studies 
I foreign language 

and DIR ge 0. 5 
and DIR It 0. 7 
then 

DIRval = medium <0. 6> . 

message "If you are trying to improve your stuuents* creativity", 
"problem solving skills, attitude toward school, or self concept,", 
"it would be better to use less direct instruction and allow more", 
"time for other types of activities.", 
endif. 



DIkofcherb: 



if 

Tlevel = junior high I high school 
and Tgoal # tests 

and Tarea = mathematics I English I science I social studies 
I foreign language 

and DIR ge 0. 7 
then 

DIRval = low <0. 6> . 

message "If you are trying to improve your students* creativity", 
"problem solving skills, attitude toward school, or self concept,", 
"it would be better to use less direct instruction and allow more", 
"time for other types of activities. ". 
endif. 



DIRother7: 
if 

Tlevel = junior high | high school 

un6 DIR It 0. 33 

then DIRval = low <0. 9>. 

message "You are providing very little direct instruction to your", 
"students. Any time direct instruction decreases below 33% of the" 
"class time, students obtain very little gain from their schooling. 
"More direct inj?truction is strongly urged. ". 
endif. 



secDIRIa: 
if 
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Tlevel = junior high I high school 
and Tarea = mathematics ! foreign language I music 
and SES = poor 
and achlevel = loK 
and DIR ge 0. 75 
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message "You are providing a high amount of direct instruction,", 

"which is a sound instructional practice Hith your students. 

"Closely monitored seatwork is needed with frequent oppor-", 

"tunities for students to respond to questions.". 
It tt 

display attach references of kb. 
display attach referenoeb of kb. 
endif . 



secDIRIb: 



if 

Tlevel = junior high | high school 

and Tarea = mathematics | foreign language I music 

and SES = middle class | upper class 

and achlevel = Ion 

and DIR ge 0. 75 

then DIRval = high <0. 6>. 

message "You are providing a high amount of direct instt -ction, ", 

"Hhich is a sound instructional practice with your students. 

"Closely monitored seatHork is needed with frequent oppor-'S 

"tunities for students to respond to questions. ", 
tt tt 

display attach references of kb. 
display attach referenoeb of kb. 
endif. 

secDIRIc: 
if 

Tlevel = junior high | high school 

and Tarea = mathematics | foreign language | music 

and SES = poor 

and achlevel = average 

and DIR ge 0. 75 

then DIRval = high <0. b>-. 

message "You are providing a high amount of direct instruction,", 

"nhich is a sound instructional practice Rith your students. 

"Closely monitored seatwork is needed with frequent oppor-", 

"tunities for students to respond to questions. ", 
It It 

display attach references of kb. 
display attach referenoeb of kb. 
endif. 



secDIRId: 
if 

Tlevel = junior high 1 high school 

and Tarea = matnematics | foreign language I music 

and achlevel = high 

and DIR ge 0. 75 

then DIRval = high <0. 7>. 

message "You are providing a high amount of direct instruction.", 

"This is a sound instructional practice with your students", 

"who need a relatively fast pace through course content.", 
tt II 

display attach references of kb. 
endif. 



secDIRIe: 
if 
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Tlevel = junior high | high school 

and Tarea = mathematics I foreign language I music 

and SES = middle class I upper class 

and achlevel = average 

and DIR ge 0. 75 



message "You are providing a high amount of direct instruction,*', 

"Khich is a sound instructional practice with your students. 

"Closely monitored seatwork is needed Kith frequent oppor-", 

"tunities for students to respond to questions.", 
II II 

display attach references of kb. 
display attach referenceb of kb. 
endif . 



secDIR1a1: 
if 

Tlevel = junior high ! high school 

and Tarea = mathematics ! foreign language ! music 

or Tgoal = tests 

and SES = poor 

and achlevel = Ioh 

and DIR It 0.75 

and DIR ge 0. 5 

then DIRval = medium <0. 7>. 

DIRprob = high. 

message "You are providing a moderate amount of direct instruction.", 

"Your students should benefit from souewhat more direct", 

"instruction. Closely monitored seatwork is needed Kith", 

"frequent opportunities for students to respond to questions.", 
II It 

display attach references of kb. 
endif. 



secDIR1b2: 



if 

Tlevel = junior high I high school 

and Tarea = mathematics ! foreign language I music 

and SES = middle class ! upper class 

and achlevel = Iok 

and DIR It 0. 75 

and DIR ge 0. 5 

then DIRval = medium <0. 5>. 

DIRprob = high. 

message "You are providing a moderate amount of direct instruction. ", 
"Your students should benefit from someKhat more direct", 
"instruction. Closely monitored seatKork is needed Kith", 
"frequent opportunities for students to respond to questions.", 

U It 

display attach references of i:b. 
endif. 



secDIR1c3: 
if 
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Tlevel = junior high I high school 

and Tarea = mathematics ! foreign language ! music 

and SES = poor 

and achlevel = average 

and DIR It 0. 75 

and DIR ge 0. 5 

then DIRval = medium <0. 5>. 

message "You are providing a moderate amount of direct instruction. ", 
"Your students should benefit from someKhat more direct", 
"instruction. Closely monitored seatKork is needed Kith", 
"frequent opportunities for students to respond to questions.". 



display attach references of kb. 
endif. 
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if 

Tlevel = junior high I high school 

and Tarea = mathematics I foreign language i music 

and achlevel = high 

and DIR it 0. 75 

and DIR ge 0. 5 

then DIRval = medium <0. 7>. 

message "You are providing a moderate amount of direct instruction. " 

"Your high achievement students Kill benefit from somenhat", 

"more direct instruction Kith a relatively fast pace through 

"course content. ", 
tt tt 

display attach references of kb. 
display attach referenced of kb. 
endif . 



secDIR1e5: 
if 

Tlevel = junior high j high school 

and Tarea = mathematics j foreign language I music 

and SES = middle class ! upper class 

and achlevel = average 

and DIR It 0.75 

and DIR ge 0. 5 

then DIRval = medium <0. 6/. 

message "You are providing a moderate amount of direct instruction. " 

"Your students should benefit from someKhat more direct", 

"instruction. Closely monitored seatHork is needed Kith", 

"frequent opportunities for students to respond to questions 
tt tt 

display attach references of kb. 
endif. 



secDIR1f6: 
if 

Tlevel = junior high | high school 

and Tarea = mathematics ! foreign language I music 

and SES = poor 

and achlevel = Iok 

and DIR It 0. 5 

and DIR ge 0. 33 

then DIRval = loK <0. 7>. 

message "You are providing a relatively Iok amount of direct instruc 

"tion. Your students should benefit from a high amount of", 

"direct instruction. They need closely monitored seatKork", 

"and frequent opportunities to respond to questions. ", 
It tt 

display attach reference3 of kb. 
display attach referenced of kb. 
endif. 



secDIR1g7: 
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if 

Tlevel = junior high ! high school 

and Tarea = mathematics ! foreign language | niusic 

and SES middle class ! upper class 

and achlevel = low 

and DIR It 0- 5 

and DIR ge 0. 33 

then DIRval = Iok <0. 5>. 

message "You are providing a relatively Iok amount of direct instruc 
"tion. Your students should benefit from a high amount of", 
"direct instruction. They need closely monitored seatKork", 
"and frequent opportunities to respond to questions. ", 
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display attach references of kb. 
display attach referenced of kb. 
endif . 



secOIRIhd: 
if 

T3 evel ~ junior high I high school 

and Tarea = mathematics ! foreign language ! music 

and SES = poor 

and achlevel = average 

and OIR It 0.5 

and OIR ge 0. 33 

then DIRval = Iok <0. 5>. 

message "You are providing a relatively Ion amount of direct mstruc 

"tion. Your students should benefit from a high amount of", 

"direct instruction. They need closely monitored seatHork", 

"and frequent opportunities to respond to questions.", 
tl It 

display attach reference3 of kb. 
display attach referenced of kb. 
endif. 



secDIR1i9: 
if 

Tlevel = junior high j high school 

and Tarea = mathematics ! foreign language I music 

and achlevel = high 

and DIR It 0.5 

and DIR ge 0. 33 

then DIRval = Iok <0. 7>. 

message "You are providing a relatively Iok amount of direct instruc 

"tion. Your students Kill benefit from a high amount of", 

"direct instruction nith a relatively fast pace through**, 

"course content. ", 
It tt 

display attach referfcnce3 of kb. 
display attach referenced of kb. 
endif. 

secDIRIjlO: 
if 

Tlevel = junior high I high school 

and Tarea = mathematics I foreign language 1 music 

and achlevel = average 

and SES - middle class | upper class 

and DIR It 0. 5 

and DIR ge 0. 33 

then DIRval = Iok <0. 6>. 

message "You are providing a relatively Iok amount of direct instruc 

"tion. Your students should benefit from a high amount of", 

"direct instruction. They need closely monitored seatnork", 

"and frequent opportunities to respond to questions.". 
It tt 

display attach referonce3 of kb. 
display attach referenced of kb. 
endif. 



secDIRIkll: 
if 
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Tlevel = junior high I high school 

and Tarea = mathematics ! foreign language I fMUsi 

and DIR It 0. 33 

then DIRval= Iok. 

message "You are providing a very Iok amount of direct instruction. " 

"Research indicates the importance o£^ai)igh amount of direc 



I (i::>i.i uu<^j.u(i* i*J Xiiiplu.. .^uuuw.iu ouuxv..wiii 

•crease direct instruction considerably. 



display attach references of kb. 
display attach referenced of kb. 
endif . 



secDIRIf: 



if Tlevel = junior high 

and Tarea = English 

and achlevel = average 

and SES = middle class I upper class 

and DIR ge 0. 75 

then DIRval - medium <0. 7>. 

message "You are providing a high amount of direct instruction. Your", 

"students should benefit from somewhat less direct instruc-", 

"ticn. They need some class time for independent reading,", 

"writing, and other activities assigned as homework. ", 
tt tl 

display attach referencel of kb. 
display attach references of kb. 
endif. 



secDIRIo: 



if 

Tlevel = junior high ! high school 

and Tarea = English 

and SES = poor 

and achlevel = low 

and DIR ge 0. 75 

then DIRval = high <0. 8>. 

message "You are providing a high amount of direct instruction, which", 
"is a sound instructional practice for your students. They", 
"should benefit from guided practice and high amount of", 
"opportunities to respond to questions. ", 



display attach references of kb. 
endif. 



\end of achlevel = low 
secDI R1z: 
if 

Tlevel = junior high 
and Tarea = English 
and achlevel = high 
and DIR ge 0. 75 
then DIRval = high <0. 8>. 

message "You are providing a high amount of direct instruction, which", 

"is a sound instructional practice for your high achievement", 

"students. They benefit from a brisk pace and generally do", 

"not require much class time for independent work.", 
II It 

display attach references of kb. 
endif. 

\*****^medium dir starts here 



secDIR1L12: 




Tlevel = junior high 
and Tarea = English 
and achlevel = high 
and DIR It 0. 75 
and DIR ge 0. 5 
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message "You are providing a moderate amount of direct instruction.*' 

"Your high achievement students should benefit from somewhat 

"more direct instruction so that they usually experience a", 

"brisk pace with relatively little time for independent", 

"work. ", 
II It 

display attach references of kb. 
endif . 



secDIRI p16: 
if 

Tlevel = junior high 

and Tarea = English 

and achlevel = low I average 

and DIR It 0.75 

and DIR gp 0. 5 

then DIR/al = medium <0. 8>. 

message "You are providing a moderate amount of direct instruction. " 

"Your low achievement students should benefit from somewhat" 
"more direct instruction. Their class time should have high 
"teacher supervision, nith high supervision even during", 
"independent work opportunities.". 

It rt 

display attach referenced of kb. 
endif. 



secDIRlsl 9: 
if 

Tlevel = high school 

and Tarea = English 

and achlevel = .low 

and DIR It 0.75 

and DIR ge 0. 5 

then DIRval = m-^dium <0. 8>. 

message "You are providing a moderate amount of direct instruction," 

"which is a sound instructional practice for your low stu-", 

"dents. They benefit from having adequate class time for", 

"completing independent work. ", 
11 tt 

display attach referenceH of kb. 
endif. 



\A'AAAAAAA*AAA*AAAiow DIR for language arts and reading starts here 

secDIR1ff32: 
if 

Tlevel = junior high ! high school 

and Tarea = English 

and achlevel = low 

and DIR It 0. 5 

and DIR ge 0. 33 

then DIRval = low <0. 8>. 

message "You are providing a rel^itively low amount of direct mstruo 
"tion. Your low achievement students still require a high", 
"amount of direct instruction in basic skills.", 

it ti 

display attach reference5 of kb. 
endif. 



secDIR1gg33: 
if 

Tlevel = junior high I high school 
and Tarea = English 



££j|>^ and SES = middle class ! upper clze^ 2?1^ 



and DIR It 0.5 
and DIR ge 0. 33 

then DIRval = medium <0. 7>. 

message "Yoa are providing a relatively Iok amount of direct mstruc-", 

"tion. Your average achievement studen:s should benefit from", 

"someKhat more direct instruction Rith some class time", 

"reserved for independent nork and for occasional small group", 

"interaction. 
II tt 

display attach referenced of kb. 
endif . 



secDIR1LL38: 
if 

Tlevel = junior high i high school 

and Tarea = English 

and SES = middle class ! upper class 

and achlevel = average ! high 

and DIR It 0. 5 

and DIR ge 0. 33 

then .OIRval = high <0. 8>. 

message "You are providing a relatively loR amount of direct instruc-" 
"tion. Your students should benefit from considerably more", 
"direct instruction. They need a brisk pace Rith relatively", 
"little class time for independent Rork. ", 



display attach reference3 of kb. 
endif. 



end secdir here 



secdirl: 



if Tlevel = junior high I high school 

and Tarea = science 

and science focus ft labs 

and achlevel = loR 

and Tgoal = tests 

and DIR ge 0. 75 

then DIRval = loR <0. ?>. 

message "You are providing a h^gh amount of direct instruction. Your", 

"students should benefit from somewhat less direct instruc-", 

"tion. They need class time for completing assignments. ", 
It tt 

display attach reference15 of kb. 
endif. 



secdir2: 



if Tlevel = junior high i high school 

and Tarea = science 

and science focus ft labs 

and achlevel = Iok 

and Tgoal = tests 

and DIR It 0.75 

and DIR ge 0. 5 

then DIRval = high <0. 7>. 

message "You are providing a moderate amount of direct instruction,", 

"Khich is a sound instructional practice Kith your students. ", 

"They need class time for completing assignments. ", 
II tt 

display attach referenced of kb. 
endif. 
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.dir3: 



if Tlevol = junior high | high school 
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and science focus # labs 

and achlevel = loH 

and Tgoal = tests 

and DIR It 0.5 

and DIR ge 0. 33 

then DIPval = loR <0. 7>. 

message "You are providing a relatively low amount of direct instruc-" 

"tion. They should benefit from somewhat more direct instruc- 

"tion. They need frequent opportunities to respond to teacher 

"questions. They also need supervision of their independent", 

"work. ", 
It II 

display attach referenced of kb. 
endif . 



secdir4: 

if Tlevel = junioi high I high school 

and Tarea = science 

and science focus # labs 

and achlevel = low 

and Tgoal # tests 

and DIR ge 0. 75 

then DIRval = medium <0. 5>. 

message "You are providing a high amount of direct instruction. Your" 

"students should benefit from somewhat less direct instruc-", 

"tion. Small group interaction and project wor!. are useful", 

"for helping improve students* self -concepts, creativity, and" 

"problem solving.", 
tl It 

display attach referencelO of kb. 
endif. 



secdir5: 

if Tlevel = junior high ! high school 

and Tarea = science 

and science focus i\ labs 

and achlevel = low 

and Tgoal # tests 

and DIR It 0. 75 

and DIR ge 0. 5 
then DIRval = high <0. 5>. 

message "You are providing a moderate amount of direct instruction", 

"which is a sound instructional practice for your students. ", 

"Small group interaction and project work are useful for help- 

"ing improve students* self -concepts, creativity, and problem" 

"solving. ", 
tl It 

display attach referencelO of kb. 
endif. 



secdirb: 

if Tlevel = junior high I high school 

and Tarea = science 

and science focus # labs 

and achlevel = low 

and Tgoal W tests 

and DIR It 0. 5 

and DIR ge 0. 33 
then DIRval = low <0. 7>. 

message "You are providing a relatively low amount of direct instruc-" 
"tion. Your students should benefit from somewhat more direct 
"instruction. Small group interaction and projects are useful 
"for helping improve students* self -concepts, creativity, and" 
"problem solving. ", 

EBIC .. ... 



I 
I 
I 

I 
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I 



I 



endif. 

secdir?: 

if Tlevel = junior high 1 high school 

and Tarea = science 

and science focus i[ labs 

and achlevel ' average 

and SES = upper class ! middle class 

and DIR ge 0. 75 
then DIRval = high <0. 7>. 

message "You are providing a high amount of direct instruction which", 

**is a sound instructional practice with your average achieve-", 

"ment science students Hhen they are not in lab. ", 
II *i 

display attach referencel of kb. 
endif. 

secdirS: 

if Tlevel = junior high 1 high school 

and Tarea = science 

and science focus # labs 

and achlevel = average 

and SES = upper class ! middle class 

and DIR It 0. 75 

and DIR ge 0. 5 
then DIRval = medium <0. 7>. 

message "You are providing a moderate amount of direct instruction. 

"Your students may benefit from somewhat more direct instruc-", 

"tion. Frequent opportunities to respond to teacher questions", 

"are important. ", 
It It 

display attach referenced of kb. 
endif. 

secdir9: 

if Tlevel = junior high I high school 

and Tarea = science 

and science focus # labs 

and achlevel = average 

and SES = upper class | middle cla^r 

and DIR It 0. 5 

and DIR ge 0. 33 
then DIRval = loH <0. 7>. 

message *'\(yu are providing a relatively Ioh amount of direct instruc-", 

"cion. Considerably more direct instruction ij^ important for", 

"your students. They need frequent opportunities to respond", 

"to teacher questions. ", 
II It 

display attach referencel 4 of kb. 
endif. 

secdir 10: 

if Tlevel = junior high | high school 

and Tarea - science 

and science focus # labs 

and achlevel = average 

and SES = poor 

and DIR ge 0. 75 
then DIRval = medium <0. 6>. 

message "You are providing a high amount of direct instruction. ", 

"Reducing this amount somenhat should be beneficial for your", 
"students nho require some class time to Hork on independent", 
"assignments. ", 
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display attach referenced of kb. 2?l5 



secdir11: 

if Tlevel = junior high I high school 

and Tarea = science 

and science focus ii labs 

and achlevel = average 

and SES = poor 

and DIR It 0. 75 

and DIR ge 0. 5 
then DIRval = high <0. 6>. 

messaflie "You are providing a moderate amount of direct instruction", 

"Hhich is a sound instructional practice for your students. 

"They benefit from frequent opportunities to respond to", 

"teacher questions and from some class time for independent", 

"Kork, ", 
It tl 

display attach referenced of kb. 
endif. 



secdir12: 

if Tlevel = junior high | high school 

and Tarea = science 

and science focus labs 

and achlevel = average 

and SES = poor 

and DIR It 0. 5 

and DIR ge 0. 33 
then DIRval = Ion <0. 6>. 

message "You are providing a relatively low amount of direct instruc- 

"tion. You should provide somenhat more direct instruction." 

"Your students should benefit from frequent opportunities to" 

"teacher questions as Kell as some class time for independent 

"Kork. ", 
It II 

display attach rer*erence14 of kb. 
endif. 



secdirl 3: 

if Tlevel = junior high | high school 

and Tarea = science 

and science focus W labs 

and achlevel = high 

and DIR ge 0. 75 
then DIRval = high <0. 8>. 

message "You are providing a high amount of direct instruction Khich" 

"is a sound instructional practice for your high achievement" 

"students. 
It II 

display attach reference5 of kb. 
endif. 



secdirlU: 

if Tlevel = junior high 1 high school 

nnd Tarea = science 

and science focus i\ labs 

and achlevel = high 

and DIR It 0. 75 

and DIR ge 0. 5 
then DIRval = medium <0. 8>. 

message "You are providing a moderate amount of direct instruction, ", 
"Providing somewhat more direct instruction should be bene-", 
"ficial. Your students should perform well when they experi- 
"ence a brisk pace of instruction with frequent opportunities 
"to respond to teacher questions. ", 



endif. 



secdirlS: 

if Tlevel = junior high 1 high school 

and Tarea = science 

and science focus W labs 

and achlevel = high 

and DIR It 0. 5 

and DIR ge 0. 33 
then DIRval = low <0. 8>. 

message "You are providing a relatively low amount of direct instruc-", 

"tion. Your students should receive considerably more direct", 

"instruction. They should perform well when they experience", 

"a brisk pace of m.ntruction with frequent opportunities to", 

"respond to teacher questions, ", 
tt tt 

display attach reference3 of kb. 
endif. 

secdirib: 

if Tlevel - junior high | high school 

and Tarea = English | social studies I health education 

and achlevel = low 

and Tgoal = tests 

and DIR ge 0. 75 

then DIRval = loH <0. 7>. 

message "You are providing a high amount of direct instruction. ", 

"Reducing direct instruction somewhat may help your low", 

"achievement students who need class time for studying and for", 

"practicing skills,", 
tt tt 

display attach referencelS of kb, 
endif. 

secdirl?: 

if Tlevel = junior high | high school 

and Tarea = English I social studies I health education 

and achlevel = low 

and Tgoal = tests 

and DIR It 0. 75 

and DIR ge 0. 5 
then DIRval = high <0. 7>. 

message "You are p^uviding a moderate amount of direct instruction", 

"which is a sound instructional practice for your students.", 

"Your low achievement students need direct instruction of new", 

"material, but they also need adequate class time for studying", 

"and for practicing skills. ", 
tt It 

display attach refGrencel of kb. 
display attach referenced of kb. 
display attach reference15 of kb. 
endif* 

secdirlS: 

if Tlevel = junior high j high school 

and Tarea = English | social studies I health education 

and achlevel = low 

and Tgoal = tests 

and DIR It 0. 5 

and DIR ge 0. 33 
then DIRval = loH <0. 7>. 

message "You are providing a relatively low amount of direct instruc-", 
O , "tion. Your students should benefit from somewhat more direct", 

JC "instruction. Frequent opportunities to respond to teacher", 



display attach referencel of kb. 
display attach referenced of kb, 
endif. 



secdir19: 

if Tlevel = junior high j high school 

and Tarea = English i social studies I health education 

and achlevel = Ick 

and Tgoal i tests 

and DIR ge 0. 75 
then DIRval = medium <0. 5>. 

message "You are providing a high amount of direct instruction. To", 

"help students improve their creativity, problem-solving, and/ 

"or self-concepts, reducing direct instruction someKhat is", 

"useful. ", 
It It 

display attach referencelO of kb. 
endif . 



secdir20: 

if Tlevel =^ junior high i high school 

and Tarea = English { social studies I health education 

and achlevel - Iok 

and Tgoal tests 

and DIR It 0. 75 

and DIR gc 0. 5 
then DIRval = high <0. 5>. 

message "You are providing a moderate amount of d.rrect instruction", 

"nhich is a sound instructional practice for your students.", 

"Rhen your teaching goal relates to improving students* crea *" 

"tivity, problem-solving, or self -concepts, providing time", 

"for small group project Kork is useful. An 'open teaching*", 

"style is helpf»il. ", 
It It 

display attach referencelO of kb. 
endif. 



secdir21: 

if Tlevel = junior high 1 high school 

and Terea = English I social studies I health education 

and achlevel = Ioh 

and Tgoal W tests 

and DIR It 0. 5 

and DIR ge 0. 33 
then DIRval = Ioh <0. 7>. 

message "You are providing a relatively Iok amount of direct in?truc-" 
"tion. Your students should benefit from having someKhat less 
"direct instructio.'^. Khen your teaching goal relates to impro-" 
"ving students* creativity, problem-solving, or creativity.", 
"In this case small group project Kork is useful. An 'open'", 
"teaching style is helpful.", 

M tl 

display attach referencelO of kb. 
endif. 



secdir22: 

if Tlevel = jfnior high | high :,ohool 

and Tarea = English | social studies I health education 
and achlevel = average 
and SES - upper class I middle class 
and DIR ge 0. 75 
^ tnen DIRval = high <0. 7>. 

message "You are providing a high amount of direct instruction Khich", 
'is a sound instructional practice for your students. ", 
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display attach reference13 of kb. 
display attach reference14 of kb. 
endif . 



secdir23: 

if Tlevel = junior high I high school 

and Tarea = English | social studies I health education 

and achlevel = average 

and SES = upper class ! middle class 

and DIR It 0. 75 

and DIR ge 0. 5 
then DIRval = medium <0. 7>. 

message "You are providing a moderate amount of direct instruction. 

"Your students should benefit from somewhat more direct", 

"instruction. Providing frequent opportunities to respond", 

"to teacher questions is helpful. ", 
II II 

display attach reference13 of kb. 
display attach referenced of kb. 
endif. 



secdir2H: 

if Tlevel = junior high I high school 

and Tarea = English I social studies I health education 

and achlevel = average 

and SSS = upper class I middle class 

and DIR It 0. 5 

and DIR ge 0. 33 
then DIRval = loH <0. ?>. 

message "You are providing i relatively low amount of direct instruc-" 

"tion. Your students may benefit from considerably more", 

"direct instruction. Providing frequent opportunities to", 

"respond to teacher questions is helpful. ", 
tf II 

display attach reference12 of kb. 
display attach reference13 of kb. 
endif. 



secdir25: 

if Tlevel = junior high | high school 

and Tare& = English I social studies I health education 

and achlevel = average 

and SES = poor 

and DIR ge 0. 75 
then DIRval = medium <0. 6>. 

message "You are providing a high amount of direct instruction. Your" 

"students should benefit from somewhat less direct instruction 

"Class time for independent uovk and for small group inter-", 

"action should be useful for them. ", 
II It 

display attach referenced of kb. 
endif. 

secdir26: 

if Tlevel = junior high | high school 

and Tarea = English | social studies I health education 

and achlevel = average 

and SES = poor 

and DIR It 0. 75 

and DIR ge 0. 5 
then DIRval = high <0. 6>. 

message "You are providing a moderate amount of direct instruction", 
"which is a sound instructional practice for your students.", 
O "Class time for independent work and for small group inter-", 

ClyL "action should be useful for them.", 



display attach referencv^m of kb. 
endif. 



secdir27: 

if Tlevel " junior high ! high school 

and Tarea = English ! social studies 1 health education 

and achlevel = average 

and SES = poor 

and DIR It 0. 5 

and DIR ge 0. 33 
then DIRval = low <0. 6>. 

message "You are providing a relatively Iok amour t of direct instruc-'* 

"tion. Your students should bene^fit from somenhat more direct 

"instruction. Providing th^m Kith frequent opportunities to", 

"to respond to teacher questions will be helpful.", 
i« tt 

display attach referencelS of kb. 
display attach referencelH of kb 
endif . 

secdir28: 

if Tlevel = junior high ! high school 

and Tarea = Engl) oh I social studies I health education 

ano' achlevel = Uigh 

and DIR ge 0. 75 
then DIRval =^ high <0. 8>. 

message "You pre providing a high amount of direct instruction Khich", 
"is a sound instructi^^nal practice for your students.", 

n tt 

display attach reference12 of kb. 
display attach reference13 of kb. 
endif . 



secdir29: 

if Tlevel = junior high \ high school 

and Tarea = English I social studies 1 health education 

and achlevel = high 

and DIR It 0. 75 

and DIR ge 0. 5 
thon DIRval = medium <0. 8>. 

message "You are providing a moderate amount of direct instruction. **, 

"Your high achievement students may benefit from sc'eKhat", 

"more direct instruction. A brisk pee Kith frequent oppor-", 

"tunities Co respond to questions is important.", 
II •« 

display attach references of kb. 
endif. 



secdir30: 

if Tlevel = junior high I higi. school 

and Tarea = English I social studies ! health education 

and achlevel = high 

and DIR It 0. 5 

and DIR ge 0. 33 
then DIRval = Iok <0. 8>. 

message "You are providing a relatively Iok amount of direct instruc-" 

"tion. Your high achievement students may benefit from con-", 

"siderably more direct instruction. A brisk pace Hith", 

"frequent opportunities to respond to questions is important." 
It It 

display attach references of kb. 
endif. 

Pp9p3ir31: 

tfyy if Tlevel = junior high I high school 260 



and science focus = labs 

or Tarea = art | home economics I industrial arts 

I physical education 
and achlevel = high | average 
and DIR ge 0. 75 
then DIRval = Iok <0. 3>. 

message "You are providing a high amount of direct instruction Khxch'*, 

"is inappropriate for lab type classes. Your students should" 

"benefit from considerably less direct instruction. They", 

"require adequate class time for practicing skills. ", 
It II 

display attach referenced of kb. 
endif . 

secdir32: 

if Tlevel = junior high | high school 
and Tarea = science 
and science focus = labs 

or Tarea = art I home economics I industrial arts 

I physical education 
and achlevel = high I average 
and DIR It 0. 75 
and DIR ge 0. 50 
then DIRval = low <0. 8>. 

message "You are providing a moderate amount of direct instruction. ", 

"Your student3 should benefit from considerably less direct", 

"instruction. They require adequate class time for practicing 

"skills. ", 
II (I 

display attach referenced of kb. 
endif. 



secdir33: 

if Tlevel = junior high I high school 
and Tarea = science 
and science focus = labs 

or Tarea = art I home economics I industrial arts 

I physical education 
and achlevel = high | average 
and DIR It 0. 50 
and DIR ge 0. 33 
then DIRval = medium <0. 8>. 

message "You are providing a relativi3ly low amount of direct instruc-" 

"tion which is still somewhat too high for activity-oriented", 

"classes. Your stuCents require adequate class time for prac- 

"ticing skills. 
It It 

display attach referenced of kb. 
endif. 



secdir34: 

if Tlevel = junior high | high school 
and Tarea = science 
and science focus = labs 

or Tarea = art | home economics ! industrial arts 

I physical education 
and achlevel = high | average 
and DIR It 0. 33 
then DIRval = high <0. 8>. 

message "You are a very low amount of direct instruction which is a", 

"should instructional practice for students in your activity-" 

"oriented class. 
ti It 

display attach referenced of kb. 
endif. 261 




secdir35: 

if Tlevel = junior high 1 high school 

and Tarea ' art I physical education 

and achlevel = Iok 

and DIR ge 0. 75 
then DIRval = medium <0. 6>. 

message "You are providing a high amount of direct instruction. Your 

"Ion achievement students should benefit from somewhat less\ 

"direct instruction. They require a lot of guided practice", 

"*^ut also some time for independent practice. ", 
It II 

display attach referencel4 of kb. 
endif . 



secdir36: 

if Tlevel = junior high 1 high school 

and Tarea - art | physical education 

and achlevel = low 

and DIR It 0. 75 

and DIR ge 0. 50 
then DIRval = high <0. 6>. 

message "You are providing a moderate amount of direct instruction", 

"Hhich is a sound instructional practice for your loH achieve 

"ment students. They require a lot of guided practice but", 

"also some time for independent practice. 
tt It 

display attach referencell of kb. 
endif . 



£;ecdir37: 

if Tlevel = junior high I high school 

and Tarea = art I physical education 

and achlevel = Ioh 

and DIR It 0. 50 

and DIR ge 0. 33 
then DIRval = medium <0. 6>. 

message "You are providing a relatively Ioh amount of direct instruc- 

"tion. Your Ioh achievement students should benefit from", 

"someHhat more direct instruction. They require a lot of", 

"guided practice but also some time for independent practice. 
II It 

display attach referenced of kb. 
endif. 



secdir38: 

if Tlevel = junior high | high school 

and Tarea = art I physical education 

and achlevel = Ioh 

and DIR It 0. 33 
then DIRval = Ioh <0. 6>. 

message "You are providing a very Ioh amount of direct i« struction. ", 
"Your students require considerably more direct instruction." 
"They need a lot of guided practice. ". 

endif. 
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secdir39: 

if Tlevel = junior high I high school 
and Tarea = science 
and science focus = labs- 

or Tarea = home economics I industrial arts 
and achieve! = Ioh 
and DIR ge 0. 75 
^ then DIRval = high <0. 6>. 

message "You are providing a high amount of direct instruction Khich" 
"is a sound instructional practice for your students. They", 



"practice. 
It II 

display attach referencelU of kb. 
endif . 



secdirUO: 

if Tlevel = junior high | high school 
and Tarea = science 
and science focus = labs 

or Tarea = home economics | industrial arts 
and achlevel = low 
and DIR It 0. 75 
and DIR ge 0. 50 
then DIRval = medium <0. 6>. 

mei?sage "You are providing a moderate amount of direct instruction. ", 

"Your lOH achievement students Kill benefit from somenhat more", 

"direct instruction. They need a lot of close supervision and", 

"guided practice.", 
It It 

display attach referenced of kb. 
endif. 



secdir41: 

if Tlevel = junior high | high school 
and Tarea = science 
and science focus = labs 

or Tarea = *iome economics | industrial arts 
and achlevel = low 
and DIR It 0. 50 
then DIRval = loH <0. 6>. 

message "You are providing a relatively Ion amount of direct instruc-", 

"tion. Your students should benefit from considerably more", 

"direct instruction. They need a lot of class supervision and", 

"guided practice.", 
11 It 

display attach referencelU of kb. 
endif. 



spedd-^ r: 

if Tarea = special education 
then 

message "This system was developed for regular education", 
"teachers Khose classrooms include mainstreamed special education", 
"students. You probably will not find the questions or the", 
"recommendations appropriate for you. If you would like to", 
"continue using the SHAP system, you nill have to begin again", 
"and use one of the other subject areas Hhen you are asked for", 
"this information.", 
endif. 



DIRa: 

if DIRval - high 
then EIRprob = none, 
endif. 



DIRb: 

if DIRval = medium 

and achlevel = average | high 

then DIRprob = none. 

endj f . 



DIRd: 

if DIRval = medium 
- and achlevel = Iok 
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and Tlevel = junior high I high school Pf>3 



then DIRprob = high, 
endif . 



DIRf: 

if DIRval = medium 
and achlevel = loH 

and Tlevel = junior high | high school 
and DIR It 0. 5 
then DIRprob - Ion. 
endif. 

DIRg: 

if DIRval = low 
and DIR ge 0. 7 
then DIRprob = high, 
endif. 

DIRi: 

if DIRval = low 

and Tlevel = junior high 1 high school 
and DIR It 0. 5 
then DIRprob = low. 
endif. 

% 

actions: 

message " 
It tt 

ft tt 

tt tt 

tt ti 

M tt 
It tt 
It tl 

Helcome 
to the 

Teacher Effectiveness Planner ", 



break. 

message " 

It tt 

> 

tt tl 

> 

" This system Hill help to determine Hhat types of training options**, 

"the system should recommend for you based upon the research literature on " 

"teacher effectiveness. Three areas of teaching practice have been 

"included in the present system: academic learning time, direct instruction 

"and questioning. The system Hill ask you questions about your students, ", 

"your classroom, your school, your common teaching practices, and your", 

"interpretation of your students* learning needs. In addition, you nill be", 

"asked to enter data from the self observations you have already completed. " 
It ft 

" For some of the questions, the answers are very specific, such as ", 

" • Hhat grade do you teach?* For other questions, the answers will require*', 
"some serious thought on your part. For example, one of the questions you*, 
"may be asked is 'Hhat is your most important teaching goal?*. Hhile we ", 
"understand that teachers almost always have more than one goal in mind for" 
"any single teaching activity, ^he system is not yet sophisticated enouj^h ", 
pnipi consider all the complexity that goes into teaching. He ask that you", 
E.__ *y to determine, to the best of your ability, the best answer to the". 



It 
tt 
II tt 
It tt 

> 

tt It 

> 

tl tt 

i 

II tt 



break. 



message *' 
II II 

II II 

II II 

" You have already been given some brief instructions about using the", 

"SNAP system on the computer, but in case you need a fen reminders, here are" 

"a feK things you should remember: 
II 11 

" 1. Hhenever you see 'ready for command*, you can do one of", 

" the following: type 'continue*, type 'explain' ", 

" if you Hould like an explanation of the question or one of the " 

" answer choices, or type 'freeze <your name>' to stop the SNAP ", 

" system and allow you to return to it at a later time.", 

II II 

" 2. If you are asked a questions that allows you to choose more "> 

" than one answer, connect your choices with the * &' symbol.", 

II II 

" 3. If you do not know an answer and cannot figure out an ai^swer", 

" that makes sense, you may enter ' unknown' for any question, ", 

" but this will result in poor response by the computer systcn:. ", 

" You will be better off simply choosing one of the possible ", 

" answer choices given to you. 

II II 

II II 
break. 



message " ". 



message " The SNAP system will now use the part of its knowledge base", 
"on teacher effectiveness that deals with the amount of direct", 
"instruction provided in a classroom. The information used to ", 
"determine whether you are providing the amount of direct instruction 
"that research would indicate is good for yovr situation .-.ill cone", 
"from data that you enter from Observation 1 (giving amounts time" 
"that the students nere in your classroom and amounts of time that", 
"you were teaching them), from additional questions that the ", 
"computer will ask you, and from drawing inferences from this data.", 



break. 

message "First the system will determine the amount of time that is allocated 

"for instruction on an average school day. ". 
obtain alloctm. 

message "The amount of allocated time (in minutes) on an average day is: ". 

display value of alloccm. 

break. 



message "How the system will determine the amount cf time that is spent in", 

"providing direct instruction to students in your classroom. ". 
obtain teachtm. 

message "The amount of teaching time (in minutes) on an average day is:". 

display value of teachtm. 

break. 



message "Now the system will determine how well your direct instruction ratio 

"( DIR) matches what riould be suggested as ideal by researchers.", 
obtain DIR. 



ERIC 



sage "Your Direct Instruction Ratio (DIR) is: 
play value of DIR. 
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break. 



obtain DIRval . 

message "The amount of direct instruction you provide in your classroom is" . 

display value of DIRval . 

break. 

message "If you Hould like to see the rule that the system used to evaluate ", 
"your Direct Instruction Ratio, type JUSTIFY DIRval". 

break. 

obtain DIRprob. 

message "Your training needs related to direct instruction are as folloKs; ". 
display value of DIRprob. 

message "You can interpret these as folloHs: ", 
" 'none* means that you have no particular training needs ", 
" related to direct instruction; ", 

" 'high* means that you are using too much direct instruction; ", 
"'•loK* m^ans that you are not providing enough direct instruction". 

Krite "a: dir. dta . DIR> DIRval, DIRprob. 

break. 



message "You are now finished Kith this section of the SNAP system. To", 
"go on to the next section, you nill have to exit from this part of the ", 
" SNAP system by typing 'stop*. Then, Khen you have the C prompt, ", 
"type • kesr altkb. pkb* ". 

break. 

% 
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text: {certification: "This knowledge base :^as Kritten by Jackie", 
"Haynes in July, 1935. "> 



{explanation: 

"This is a knowledge base to evaluate the amount of academic learning", 
"time taking place in a classroom. It uses the research literature", 
"to determine values for the attribute ALT, which is determined by", 
"success level, allocated time, and engaged time. It includes references" 
"to literature on ALT evaluating how much ALT is taking place and hoK", 
"helpful it is to a teacher's particular teaching situation. "> 

♦•9 

attributes: 



alloctm: real 

[constraint: alloctm ge 0.0 and alloctm le 600.01 
{explain: "is the total amount of time that COULD", 
"be used for instruction. It excludes time used for recess, lunch, 
"school plays, transition from one class tu another, etc. "} 
{definition: "The amount of time students are in their classroom m 
"given school day" . 

schoolday: real 

[constraint: schoolday ge 0.0 and schoolday le 600.0] 
{question: "How long is the average school day (in minutes)?"} 
(definition: "the length (in minutes) of an average school day"}. 

allocrate: real 

[constraint: allocrate ge 0.0 and allocrate le 1.01 
[calculation: alloctm / schoolday!. 



allocval: sgl 

( high, medium, Ioh) 

{explain: "The value of the amount of allocated time"}. 



engagrate.hi: real 

[constraint: engagrate_hi ge 0.0 and engagrate_hi le 1 . 0] . 

engagrate_med: real 

[constraint: engagrate_med ge 0. G and engagrate^med le 1 . OJ . 



engagrate_loK: real 

[constraint: engagrate_lott ge 0.0 and engagrate^low le I.OJ. 

engagrateA: real 

[calculation: engagrate_hi + engagrate_med +• engagrate^lowJ . 
engagrate: real 

[constraint: engagrate ge 0.0 and engagrate le I.OJ 

(calculation: engagrateA / 33. 



classperiod: int 

[constraint: classperiod ge 30 and classperiod le 901 

{question: "Hon long is a single teaching period your school?"! 



engagtimeval: sgl 

(high, medium, Ioh) 

{explain: "An evaluation of the amount of engaged time"} 
O 2lev: sgl 

ERIC (high {explain: "succlev ge 0.85'*}, OQ^ 



lOH {explain: "succlev It .70"}) 
{explain: "The amount of success experienced by students is", 
"an important variable in teacher effectiveness."}. 



succlev.high: sgl 
( high 

{question: "above 35^ correct"}, 
medium 

{question: "between 70% and 85% correct"}, 

lOH 

{question: "less than 70% correct"}) 

{explain: "The amount of success experienced by students is", 

"an important variable in teacher effectiveness."} 
{question: "From Observation 3» how would you rate the sucoes 
"level of the high students you observed?"]. 

succlev_med: sgl 
( high 

{question: "above 35% correct"}, 
medium 

{question: "between 70% and 85% correct"}, 
lo» 

{question: "less than 70% correct"}) 

{explain: "The amount of success experienced by students is", 

"an important variable in teacher effectiveness."} 
{question: "Prom Observation 3, how Hould you rate the succes 
"level of the average students you observed?"}. 

succlev.low: sgl 
( high 

{question: "above 85% correct"}, 
medium 

{question: "between 70% and 85% correct"}, 
low 

{question: "less than 70% correct"}) 

{explain: "The amount of success experienced by students is", 

"an important variable in teacher effectiveness. "} 
{question: "From Observation 3> how would you rate the succes 
"level of the low students you observed?"}. 

Qsucclev_H: sgl 

(high, ncdium, low), 

Qsucclev_M: sgl 

(high, medium, low). 

Qsucclev.L: sgl 

(high, mediurp, low). 

Successes.H: int. 

2uccesses_M: int. 

Successes_L: int. 

Responses.!!: int. 

Responses.M: int. 

Responses.L: int 

highS: int. 
mediums: int. 
IohS: int. 

Er|c''^' int. 2(^8 

^" TrS o r ft <5 on n rl H* int 



Opprespond.M: int. 



Opprespond.L: int. 

Opprespond.tot: int. 

succrate.high: real. 

succrate.med: real. 

succrate_10H: real. 

indepsucclev: sgl 

(high, medium, low). 

successprob_high: sgl 

( present absent) . 

successprob_med" sgl 

(present, aosent). 

successprob^low: sgl 

( present, absent) . 

successprob: sgl 

( present, absent) . 

ALT: sgl 

( high, medium, low) 

{explain: "ALT is based on the value of success level", 
" ( succlev) , allocated time ( alloctm) , and", 
" engaged time ( engagtime) , 

ALTprob: mlt 

( none, successlev, allocated_time, engaged_time, info) 
{explain: "ALTprob means there is a problem with ALT"). 

externals: 



obs2: 



obs3: 



t program: "ob2"3 

[outputs: i?uccrate_high, succrate.med, 

succrate_low) 
[ outputf ile: ••ob2. dta"3 . 

t program: "ob3"l 

C outputs: engagrate_hi, engagrate_med, angagrate_lo«, 

succlev_high, succlev_med, succlev_low) 
C outputf ile: "ob3. dta"! . 



rules: 

\the cut-off points for engagement rates are designed to be very 
\stringent in assignment of HIGH , since it i5, assumed that tne data 
\obtained thru self -observation are going to be inflated. The inflation 
\may be due to the bias of teachers selecting favorable times to obser/e 
\o»* simply because teachers will usually (we assume) be observing then* 
\scudents at seatwork *^hich students know will be collected and graded 
\( so teachers can evaluate their succlev). 

l^l)9^aS>^ate1: 

!r:S!.^ engagrate ge 0.90 2^9 



endif . 
\ratbook, BTES p. 353 



ensagrate2: 

if engagrate It 0. 90 

and engagrate ge 0.65 

then engagtimeval = medium <0. 3>. 

endif. 
\fatbook, p. 353 
engagrateS: 

if engagrate It 0. 65 

then engagtimeval = Iok <0. 9>. 

endif. 
\f atbook, p. 353 

alloc tm1: 



if allocrate ge 0. 65 

then allocval = high <0. 9>. 

endif. 



\ref erence BTES fatbook, p. 352 
alloctm2: 



if allocrate It 0, 65 

and allocrate ge 0.^0 

then allocval = medium <0. 8>. 

endif. 



\ref erence BTES fatbook, p. 352 
alloctm3: 



if allocrate It 0. 4u 
then allocval = low <0. 8>, 
endif. 



\ref erence BTES fatbook, p. 352 
seatsucclevi : 



if succl«v_high = high 
and succlev^med = high 
and succlev_l0H = high 
then indepsucclev = high, 
endif. 



if succlev^high = high 
and succlev_med = medium 
and succlev^lOH = high 
then indepsucclev = high, 
endif. 



if succlev_high = high 
and succlev^med = medium 
and succlev^lOH = medium 
then indepsucclev = medium, 
endif. 



if succlev^high = high 
and succlev^med = medium 
and succlev^low = low 
then indepsucclev = Iok. 
endif. 



seatsucclev2: 



seats ucclev3: 



seatsucclevU: 
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and succlev.med = Ioh 
and suoclev_low = high 
then indepsucclev = medium, 
endif. 



seatsucclev6: 

if succlev.high = high 
and succlev^med = Ioh 
and succiev_low = medium 
then indepsucclev =: medium, 
endif. 



seatsucclev?: 

if succlev.high = high 

and succlev^med = low 

and succlev_l0H = low 

then indepsucclev = low. 
endif. 



seatsucclevS: 

if succlev..high = high 
and succlev^med = high 
and succlev_low = low 
then indepsucclev = medium, 
endif. 



seatsucclev9: 

if succlev_high = high 

and succlev.med = high 

and succlev.loR = medium 

then indepsucclev = medium, 
endif. 



seatsucclevIO: 

if succlev.high = medium 

and succlev^med = high 

and succlev_low = high 

then indepsucclev = high, 
endif. 

seatsuc'clevi 1 : 

if succlev.high = medium 

and succlev^med = high 

and succlev_loR = low 

then indepsucclev = medium, 
endif. 



seatsucclev12: 

if succiev_high = medium 
and succlev_med = high 
and succlev.loK = medium 
then indepsucclev = medium, 
endif. 



seatsucclev13: 

if succlev.^high = medium 
and succlev.med = medium 
and succlev.low = high 
then indepsucclev = medium, 
endif. 



seatsuccl evi ^: 

if succlev_high = medium 
O , and succlev^med = medium 

ERJC ind succle^'.low = medium 

~™ hhen 1 nden<?uool ev = medium. 
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endif . 



seatsucclev15: 

if succlev.high = medium 

and succlev.med medium 

and succlev.lOK = Iok 

then indepsucclev = low. 
endif. 



seatsucclevlb: 

if succlev.high = medium 
and succlev.i-ned = Iok 
and succl"v_l0K = high 
then indepsucclev = medium, 
endif. 



seatsucclev17: 

if succlev.high = medium 
and succlev_med = low 
and succlev.loR - medium 
then indepsucclev = low. 
endif. 



seatsucclevi 8: 

if succlev^high = medium 

and succlev_med = low 

and succlev.loR = low 

then indepsucclev = Iok. 
endif. 



seatsucclevi 9: 

if succlev^higb = Iok 

and succlev_med = high 

and succlev.lOK = high 1 medium 

then indepsucclev = medium. 

endif. 



seatsucclev20: 

if succlev^high = Iok 

and succlev_med = high 

and succlev.lOK = Iok 

then indepsucclev = Iok. 
endif. 



seatsucclev21 : 

if succlev^high = Iok 

and succlev_med = medium 

and succlev.lOK = high I medium 

then indepsucclev = medium. 

endif. 



seatsucclev22: 

if succlev^high = Iok 

and succlev.med = medium 

and succlev_l0K = loH 

then indepsucclev = Iok. 
endif. 



seatsucclev23: 

if succlev^hi£.j = Iok 

and succlev_med = Iok 

and succlev.lOK = high I medium I Iok 
then indepsucclev = lou. 
i-n9i^ endif. 
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suoclevi : 



if succrate.high ge 0. 70 
then Qsuoclev^H = high <0. 9>. 
endif . 
\fatbook, p. 3U1 

succlev2: 

if succra teamed ge 0.75 
then Qsucclev.M = high <0. 3>. 
endif. 

\fatbook, p. 3141 

succlev3: 

if succrate^loH ge 0.80 
then Qsucclev^L - high <0. 9>. 
endif. 

\fatbook, p. 3141 

succlevi^: 

if succrate^high ge 0.65 
and succrate^high It 0.70 
then Qsucclev_H = medium <0. 3>. 
endif . 

\fatbook, p. 341 

succlevS: 

if succrate^med ge 0.70 

and succrate^med It 0.75 

then Qsucclev^M = medium <0. 7>. 

endif. 

\fatbook, p. 341 

succlevb: 

if succrate^low ge 0.75 

and succrate.loH It 0. 8 

then Qsucc.lev^L = medium <0. 8>. 

endif. 

\fatbook, p. 3141 

succlev7: 

if succrate^high It 0.65 
then Qpucclev^H = low <0. 9>. 
endif . 

\fatbook, p. 341 

- uccle^S: 

if succrate^med It 0.70 
then Qsucclev^M = low <0. 3>. 
endif. 

\fatbook, p. 341 

succlev9: 

if succrate.low It 0.75 
then Qsucclev^L = low <0. 9>. 
endif. 

\fatbook, p. 341 

successi : 

if succlev^high = high | medium 
and Qsucclev^H = high ! medium 
then successprob.high = absent. 
\ endif. 



success2: 

O ^ if succlev^high = low 



ERJC or Qsucclev.H = low 2*73 



fhen <5uooes.<?nroh hi^h = nr»*sftnt 



endif. 



successS: 

if succlev.med ^ high 

and Qsucclev^M = high 

then successprob^med = absent. 

endif. 



successU: 

if succlev^med = medium j low 
and Qsucclev^M = medium ! low 
then successprob.iTfSd = present, 
endif. 



successS: 

if succlev^iOH = high 

and Qsucclev ^ = high 

then success^rob^IoK = absent. 

endif. 



successb: 

if succlev_low ~ medium 1 low 
and Qsucclev^L = mediurn I low 
then successprob^low = present, 
endif. 



successprobi: 

if successprob^high = absent 
and successprob.med = absent 
and successprob^low = absent 
then successprob = absent. 

succlev = high, 
endif. 



successprob2: 

if successprob^high = absent 
and successprob^med = present 
and successprob^lOH = absent 
then successprob - present, 
succlev = medium. 

endif. 



successprobS: 

if successprob^high = absent 
and successprob.med = absenc 
and successprob^low = present 
then successprob = present, 
succlev = mediu'n. 

endif. 



successprobij; 

if successprob^high = present 
an'3 successprob^med = present 
and successprob oh = present 
then successprob = present, 
succlev = low. 
endif. 



successprobS: 

if successprob^high = present 
and successprob.med = absent 
and successprob^low = absent 
then successprob = present 
succlev = medium, 
endif. 
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successprobb: 

if successprob.high = present 
and successprob_med = absent 
and successprob^^lOH = present 
then successprob = present, 
succiev = ioH. 
endif. 



successprob?: 

If successprob.high = absent 
and successprob.med = present 
and successprob_low = present 
then successprob = present, 
succiev = low. 
enJjf. 



successprobS: 

if successprob.high = present 
and successprob.med = present 
and successprob.lOK = absent 
then successprob = present, 
succiev = medium, 
endif. 



\*^alt1 
altrulel : 

if succiev = high 

and allocval - high | medium 

and engagtimeval = high 

then 

ALT = high <1. 0>. 

message "The amount of Academic Learning Time available", 
"in your classroom appears to be quite high. 

endif. 



altruleS: 

if 

succiev = loR 

and allocval = high 

and engagtimeval = high 

then 

ALT = medium <0. 9>. 

message '*The lack of success that your students experience'*, 

"is probably hindering their academic achievement." 
'*The activities vou are planning are too ", 
'•difficult for them. Try making their work easier" 
"and see if their achievement improves." 

endif. 
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altt uleU: 

if succiev = high 

and allocval = low 

and engagtimeval = high 

then 

ALT = high <0. 3>. 

message "Although your students appear to be engaged", 

"in learning tasks at a high rate, the aniount", 
"of time available for instruction seems to be", 
"somewhat shorter than it should be. Perhaps", 
"you could arx^ange the schedule for your students", 
"so that th->y have more time in class for learning. 
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altrulsS: 

if succl*^v = high 

and allocval = medium 

and engagtimeval = medium 

then 

ALT = medium <0. 9>. 

message "Although your students are successful in performing", 
"their learning tasks, they are not engaged in those", 
"tasks as much as they should be, nor are they spending", 
"enough time in actual learning situations. You should", 
"consider whether there are Hays to rearrange the schedule", 
"of your school day to provide for more instructional time,", 
"and to consider adopting some instructional and behavior", 
"management techniques to improve the academic learning ", 
"tifiie of students in your classroom.", 

endif . 



altruleb: 

if succlev = high 
and allocval = high 
and engagtimeval = Ioh 
then 

ALT = medium <0. 9>. 

message "You should try to plan instructional and behavior", 
"management activities that Hill increase the amount", 
"of time your students are engaged in their learning", 
"tasks. ". 

endif. 



altrule?: 

if succlev = high 

and engagtimeval = medium 

and allocval = Ioh 

or succlev = medium 

and engagtimeval = high 

and allocval = Ioh 

then ALT = medium <0. 9>. 

message " Yoi:r students appear to be successful in their learning", 
"activities and engaged a good amount of the time ", 
"available for instruction, but they need more instructional", 
"time each school day. Perhaps you could try to arrange", 
"a schedule that Hill allow for more instructional ", 
"time in a school day.". 

endif. 



altruleS: 

if allocval = Ioh 

and engagtimeval = Ioh 

then 

ALT = lOH <1. 0>. 
message "You should try to plan for more instructional time", 

"each day and for instructional and behavior management", 
"techniques that will increase the amount of time your", 
"students are engaged in their learning activities.". 

endif. 



altrule9: 

if allocval = medium 
pp9p" and engagtimeval = Ioh 

LI\L^ and sucnli^v = hi ffh 



or succlev = niedium 
then 

ALT = medium <0. 8>. 
message ''Your students need more J earning time, either by", 

"increasing their engagement rate, or by increasing", 
"the amount of time available for instruction in the", 
"school day. Their success level is good, Khich may", 
"indicate that they are off-task because the Kork is", 
"too easy for them. ". 

endif . 
altrulelO: 

if 

succlev = lOK 

and allocval = Ioh 

and engagtimeval = high 

then 

ALT = medium <0. 9>. 
message "Your student achievement level Kould probably", 

"improve if they Here more successful (their Kork", 
"was easier for them) and if more time for learning", 
"activities took place each day. '\ 

endif. 

altrulel Oa: 

if succlev = lOH 

and allocval = low 

and engagtimeval = medium 

then ALT = Ioh <0. 8>. 

message "Your students* achievement level Kould probably", 
"improve if they were more successful (their Hork", 
"»as easier for them) and if more time for learning", 
"activities took place each day.", 
endif. 

al trulella: 

if succlev = medium 

and engagtimeval = medium 

then ALT = medium <0. 9>. 

message "You are combin ,ng moderate amounts of success, available", 
"instructional time and a relatively strong engagement rate. ", 
"Imf jving ai.y of these would also improve student achievement. ". 
endif. 



altrule13: 

it succlev = low 
and allocval = high 
or allocval = medium 
and engagtimeval = medium 
then ALT = medium <0. 9>. 
message " You may be able to improve the achievement of your", 
"students by increasing their opportunities to be", 
"successful. Doing so may help to improve the amount", 
"of engaged time, which should load to improved locirning. 

endif. 



altrule14: 
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if succlev = lOH 

and allocval = medium 

a.'»d engagtimeval = high 

then 

ALT = jTiedium <0. 9>. 

message "Your students are on task most of the ti;ne, but they ", 
"mav be f rustrat /d bv their inabxlitv to do the Hork that" 
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"is required of them. Their acnievement would probably", 
"improve if they were given work at an easier level where", 
"they could be more successful.". 

endii . 



altrulelS: 

if succlev = low 

anJ engagtimeval = low 

and 

allocval = high 

or allocval = medium 

then ALT = low <0. 9>. 

message "There appear? to be enough instructional time available", 
"each day, but ycur students are frequently off task and 
"not engaged in their learning activities. Also, they ", 
'•seem to have great difficulty with their work. Student", 
"engaged time may improve if you try to provide them with", 
"more opportunities for success by assigning easiei' Kork", 
"and by trying to provide more motivating activities.". 

endif. 



altrulel7: 

if succlev = medium 

and allocval = high 

a:id engagtimeval = low 

then ALT = medium <0. 8>. 
message "Although there is a large amount of instructional time", 
"available in your class, your students are not engaged", 
"in their learning tcisks very much. Increasing the amount", 
"of success may help to improve students* engagement rate,", 
"or planning for more direct instruction ma^ haip to improve" 
"engagement rate." . 

endif. 



altrulelS: 

if succlev = high 
and allocval - high 
and engagtimeval = medium 
then ALT = high <0. 9>. 
message "You are maintaining very high rates of success and available 
"instructional tine. However, increasing the amount of tine" 
"your students are actually on task may help to improve their 
"achievement levels. ". 

endif. 



altrule19: 

if succlev = h?gh 

and allocval ^ low 

and engagtimeval = medium 

then ALT = medium <0. 9>. 
message "You are maintaining very high rates of success, but * ne", 
" amount of time available for instruction is not enojgh. ", 
"Your students' achievement would probably improve if you", 
"try to change the schedule sOk^ewhat so tha*: students have ", 
"more time to learn. ", 

endif. 



altruleP.O: 

if succlev = medium 

and allocval = medium 273 
O _ and engagtimeval = high 
ERJC then ALT = medium <0. 9>. 

inimiimFirnniin me.<?saffR "You are mfl 1 n h;» 1 n 1 n« a mofirtra^ft rah^ nf fjucoess with a* 



"moderate amount oC instructional time. By increasing", 
"your students' success level, both their engagement race 
"and their achievement level may improve. ". 

endif . 



altrule21: 

if succlev = medium 
and allocval = medium 
and engagtimeval = Ioh 
then ALT = medium <0. 9>. 

message "You are maintaining a moderate rate of success uith a" 
"moderate amount of instructional time, however your ", 
"students are frequently off task. By providing more", 
"motivating activities, or activities allowing for even", 
"higher success level, their engagement rate may improve. 

endif. 



ALTprobI : 

if ALT = high 

then ALTprob - none. 

endif. 



ALTprob2: 

if ALT = medium | low 
and allocval - medium | low 
and successprob - absent 
and engagtimeval - high 
then 

ALTprob = allocated^tiffie & info, 
endif. 

ALTprob3: 

if ALT = medium I low 
and allocval - medium I low 
and successprob = present 
and engagtimeval = high 

then ALTprob = allocated^time t successlev & Ln^o. 
endif. 



ALTprobi^: 

if ALT = medium | low 

and allocval = medium i low 

and successprob = absent 

and engagtimeval medium I lew 

then ALTprob = allocated.time 8. engaged^time & info, 
endif. 



ALTprobS: 

if ALT = medium ! low 

anC allocval = medium \ low 

and successprob = present 

and engagtimeval = medium I low 

then ALTprob = allocated. time & engaged^time & successlev 8. int'o. 
endif. 



ALTprobb: 

if ALT = medium I low 

and allocval = high 

ana successprob = present 

and engagtimeval = medium ! lo'^ 

then ALTprob = engaged.time & successlev & info. 

endif. 



PP<f^-prob7: 

if ALT = medium 1 Ioh 
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and aJlocvaJ = hi«h ^ 



and successprob ~ present 

and engagtimeval = high 

then ALTprob = successlev & info. 

endif . 

ALTprobS: 

if ALT = medium ! low 

and allocval - high 

and successprob = absent 

and engagtimeval = medium ! low 

then ALTprob = engaged.time & info. 

endif. 



actions: 
message " 



Helcome 
to the 

Teacher Effectiveness Planner, Part 2 



break, 
message 



"This part of the SNAP system evaluate Academic Learning Time (ALT). 
"The concept of ALT includes three important features of instruction 
"for students: how r.iuch time is available to them for instruction", 
"in their academic subjects, how much of the time they are engased", 
'Vin their learning tasks, and how much of the time they are being", 
"successful in their tasks. A large body of research has found that 
"achievement is highest when students are on task and extremely", 
"successful for large amounts of the school day. The SNAP system", 
"recognizes that allocated time is noL easy for teachers to change", 
"since they have no effect on the length or number of school days,", 
"on non-academic school activities, or on scheduling of schoolwide", 
"events. However, ths other facets of ALT are more directly in", 
"the control of an individual teacher and therefore were weighed", 
"more hea ily in evalu^^ting any given case. ", 



II tt 
It II 
It It 



break. 

message " The SN4P system will begin evaluating your ALT by determining", 
"the ratio of allocate'! time to the length of the school day. 

read "a: timal. dta", alloctm. 
obtain allocval. 

message "The amount of allocated time in your teaching siv.uat.ion ti>. 

display value of allocval. 

break. 



Q age "The next step the SNAP system will use to determine your ALT statu? 

"is to determine hoi; successful your students are in their daily", 
^sm "classroom exn^rienc^Sx You will bft ^^sked t-o enher da*:-, ^ '^th 



"Observation 2, Hhich includes students' success in a teacher- led" , 
"discussion, and Trom Observation 3> which mcludcjj their success", 
"at seatHork. 



obtain succlev. 

message "The amount of success your students experience at ", 
"seatKork is:". 

display value of indepsucclev. 

message "The success rate of your high students during discussions is 
display value of succrate^higrt. 

message "This rate of success for high students is", 
display value of Qsucclev_H. 

message "The success rate of average students during discussions is", 
display value of succrate_med. 

message "This rate of success for average students is ". 
display value of Qsucclev^M. 

message "THe success rate of low students during discussions is", 
display value of succrate.low. 

message "This rate of success for loK students is.". 

display valuo of Qsucciev^L. 

break. 

message "Nok the SNAP system will ev7\luate ho. much v*/ the ciine your students 
"are activly engaged in their learning tasks. You will be asked to", 
"provide data collected during Observation 3. ". 
obtain engagtimsval. 

message "The amount of engaged time observed in your classroom as ". 
display value of engagtimeval. 
message " ". 
break. 

message "Noh SKA? is ready to determine a value for ALT. ". 
message " ALT is ". 
display value of ALT 
break. 

obtain ALTprob. 

message "According to the data you provided and the rul^i in this", 
"system, your training needs concerning Academic Learning Time are:", 
display value of ALTprob. 
break. 

break. 



message "Hhen you are ready to leave this part of the SNAP system, type", 
"STOP. Then, to start the next part dealing with questioning, type", 
"kesr neKqueskb. pkb. ". 
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\This is the QUES knoHledge base begun 4/7/86 
attributes: 



schoolday: real 

[constraint: schoolday ge 0.0 and schoolday le 600.0) 
'question: "Hok long is the average school day (in minutes)?") 
{definition: "the length (in minutes) of an avera^je school day") 



classperiod: int 

(constraint: classperiod le 903 

{question: "Hoh long is a single teaching period in yov sohoolV 
Opprespond_H: real. 
\from pascal program 

Opprespond_M: real. 

Opprespond.L: real. 

Opprespond_tot: real 

\total number of responses given by all students in one observation 
\from pascal program 

opprespond: sgl 

( high, medium, low) 

{question: "Hon many opportunities to respond do students have?" 

succrate_high: real 
succrate_med: real 
succrate_low: real 

\Hill come from pascal program, avg of days 2 and 4 

i ndepsuccl ev: sgl 

{ high, medium, loti) . 

successprob^^high: sgl 

( present, absent) . 

successprob^^med: sgl 

( prese'^t, absent) . 

successprob^^lon: sgl 

( present, absent) . 

successprob: sgl 

( present, absent) . 

highSs: int 

{question: "Hoh many high students are in the class?"). 
mediumSs: int 

(que.stion: "How many medium students are in the class?"). 
lowSs: int 

{question: '"How many low students are in the class?"), 
total Ss: int 

[calculation: highSs *• mediumSs losiSs 1. 

Distrib^H: real 

y . [calculation: highSs / totalSs). 
t^K>:rls,H: real 2cS2 



Distrib^L: real 

(calculation: IokSs / tolalSsl. 



Responses. H: real 

{question: "How many responses did high students make?"). 
Responses.M: real 

{question: "How many responses did mcdiuin students make?"/. 
Responses.L: real 

{question: "How many responses did low students make?"/. 
Responses. tot: real 

(calculation: Responses. H + responses. M >• Responses. Ll . 

RespDistrib.H: real 

( calculation: Responses. H / Responses. tot] . 
RespDistrib.H: real 

(calculation: Responses. M / Responses. tot] . 
RespDi stri b.L: real 

(calculation: Responses. L / Responses. tot] . 

oppratio.R: real 

(calculation: RespDistrib.H / Distrib.H]. 
oppratio.M: real 

(calculation: RespDistrib.H / Distrib.M] 
oppratio.L: real 

(calculation: RespDxstrib.L / Distrib.Ll. 

LowOpp: sgl 

(toohigh, OK, toolow) 

{que-rtion: "The proportion of responses made by low students is: ">. 
Med'umOpp: sgl 

(toohigh, OK, toolow) 

{question: "The proportion of responses made by medium scudents is: "> 
HighOpp: sgl 

(toohigh, OK, toolow) 

{question: "The proportion of responses made by high students is: 

distribprob: mlt 

(highS, mediums, lowS, none). 
\values = high, medium, and low students not getting enough questions 

responseprob: sgl 

( present, absent) . 



qskill: sgl 

( excellent, good, fair, poor) 

{question: "How good is the teacher at asking questions in a ", 
"manner that distributes response opportunities fair y ", 
"provides for students' success, and arks questions ", 
"at a rate appropriate for the specific instructional group.") 



respdistrib: sgl 

(even, high students, low students, average students, other). 



q'lesprob: mic 

(highS, mediums, lowS, none, info, response. opp) . 



\KHOHLEDGE BASE: QSKiLLS.PS (a knowledge base to determine a teacher's 

er|c 



\ skills at questioning) 



rill 
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ruspdistribi: 

it oppritio^H gt 1.25 
then HighOpp = toohigh. 

message "You appear to be directing too many questions to your high" 

"achievement students, which indicates that the other groups 

"are not having sufficient opportunities to respond,", 
II II 

display attach reference? of kb. 
endif. 



respdistrib2: 

if oppratio.H It 0.75 
then HighOpp = toolOR. 

message "You are not directing sufficient questions to your high", 

"achievement students. Increasing their opportunities to", 

"respond may improve their performance.", 
II 1} 

display attach reference? of kb. 
endif. 



respdistri b3: 

if oppratio.H le 1.25 
and oppratio_H ge 0. 75 
then HighOpp = OK. 

message "Your high achievement students are having sufficient oppor- 

"tunities to respond to questions. Opportunity to respond", 

"to question- is posi:itively related to achievement.", 
II II 

display attach reference? of kb. 
endif. 



respdistri b2|: 

if oppratio.M gt 1.25 
then HediumOpp = toohigh. 

message "Your average achievement students are having to many oppor 

"tunities to respond to questions. Other students need", 

"sufficient opportunities to respond as well.", 
II II 

display attach reference? of kb. 
endif. 



respdistri b5: 

if oppratio.M It 0. 75 
then HediumOpp = toolow. 

message "Your average achieverrent students are not having enough", 

"opportunities to respond to questions. To improve their", 

"achievement, you should provide more opportunities to", 

"respond. 
II II 

'jisplay attach reference? of kb. 
endif. 



respdistri b6: 

if oppratio.M le 1.25 
and oppratio^M ge 0. 75 
then HediumOpp = OK. 

message "Your average achievement students are having sufficient", 

"opportunities to respond to questions. Opportunity to res- 

"pond to questions is positively related to achievement.", 
II II 

dis'play attach reference? of kb. 
endif. 
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then LoKOpp = toohigh. 

message "Your Iok achievement students are having too many oppor-", 

"tunities to respond to questions. Other students need", 

"sufficient opportunities to respond as Kell. 
•t tt 

display attach references of kb. 
endif . 

respdistri b8: 

if oppratio.L It 0.75 
then LoKOpp = toolOK. 

message "Your Iok achievement students are not having enough oppor-'*, 

"tunities to respond to questions. To improve their achieve-" 

"ment, you should provide more opportunities to respond.", 
It It 

display attach references of kb. 
endif. 

respdistri b9: 

if opnratio.L le 1.25 
and oppratio_L ge 0.75 
then LoKOpp = OK. 

message •*Your low achievement students are having sufficient oppor-", 

"tunities to respond to questions. Opportunity to respond", 

"to questions is positively related to achievement.", 
tt tt 

display attach reference^ of kb. 
endif. 

respdistri b1 0: 

if LoKOpp = OK 

and HediumOpp = OK 

and HighOpp = OK 

then distribprob = none. 

message "You are not observed as having a problem Kith the distribu-", 

"tion of questions among the high, medium, and Iok achievement 

"groups in your class. 
ti It 

display attach references of kb. 
endif. 

respdistri b11: 

if LoKOpp = OK I toohigh 
and i. .diumOpp = OK 
and HighOpp - toohigh 
then distribprob - none. 

message "You are not observed as having a problem with the distribu-", 

"tion of questions among the high, medium, and lo^* achievement 

"groups in your class. 
It It 

display attach references of kb. 
endif. 

respdi stri b1 2: 

if LoKOpp = OK I toohigh 
and KediumOpp = OK 
and HighOpp = toolow 
then distribprob = highS. 

message "Your high achievement stiidents are not having sufficient", 

"opportunities to respond to questions.", 
11 11 

display attach references of kb. 
endif. 

O 

>distrib1S: 2S5 

1 P r.nwOnn = nV 1 t*nnhi crh 



and MediumOpp = toohigh 
and HighOpp = toohigh 
then distribprob = none. 

message "You are not observed as having a problem with the distnbu-", 

"tion of questions among the high, medium, and Ioh achie /ement*' 

"groups in your class. 
It (I 

display attach references of kb. 
endif . 



respdistribm: 

if LoHOpp = OK ! toohigh 

and HediumOpp = tooloH 

and HighOpp = toolow 

then distribprob = mediums 8. highS. 

message "Your average and high achievement students are not having", 

"sufficient opportunities to respond to questions.", 
ti II 

display attach references of kb. 
endif. 



respdistribIS: 

if LoHOpp = OK I toohigh 
and MediumOpp = toohigh 
and HighOpp = toolow 
then distribprob = highS. 

message "Your high achievement students are not having sufficient", 

"opportunities to respond to questions.", 
II It 

display attach references of kb. 
endif. 



respdistribib: 

if LowOpp = OK I toohigh 
and MediumOpp = toolow 
and HighOpp = toohigh 
then distribprob = mediums. 

message "Your average achievement students are not having sufficient", 

"opportunities to respond to questions.", 
II It 

display attac. references of kb. 
endif. 



respdistrib17: 

if LowOpp = OK 1 toohigh 
and MediumOpp = toohigh 
and HighOpp = OK 
then distribprob = none. 

message "You are not observed as having a problem ;*ith the distribu^", 

"tion of questions among the high, medium, and low achievement" 

"groups in your class. 
II ti 

Jisplay attach references of kb. 
endif. 



respdistribIS: 

if LowOpp = OK I toohigh 
and MediumOpp = toolow 
and HighOpp = OK 
then distribprob = mediums. 

message "Your average achievement students are not having Gufficient", 
"opportunities to respond to questions.". 



^ . display attach references of kb. 
yyj; endif. 



respdistrib19: 

if LoHOpp = toolo« 
and HediumOpp = Ok 
and HighOpp = toohigh 
then distribprob = IokS. 

message "Your Iok achievement students are not having sufficient", 

"opportuni tifts to respond to questions. 
II It 

display attach references of kb. 
endif. 



respdistrib20: 

if LoKOpp = tOOlOK 

and HediumOpp = OK 

and HighOpp = toolOK 

then distribprob = highS & IokS. 

message "Your high and low achievement students are not having", 

"sufficient opportunities to respond to questions.", 
II II 

display attach references of kb. 
endif. 



respdistrib21: 

if LowOpp = tooloH 
and HediumOpp = toohigh 
and HighOpp = toohigh 
then distribprob = IohS. 

message "Your Iok achievement students are not having sufficient", 

"opportunities to respond to questions. ", 
II 11 

display attach references of kb. 
endif. 



respdistrib22: 

if LoKOpp = tOOlOH 
and HediumOpp = toolOK 
and HighOpp = toolow 

then distribprob = mediums % highS & IohS. 

message "Students in high, medium, an<i low achievement groups are not", 

"having sufficient opportunities to respond to questions.", 
II It 

endif. 



respdistrib2S: 

if LoROpp = tOOlOH 

and HediumOpp = toohigh 

and KighOpp = toolow 

then distribprob = highS & IokS. 

message "Your high and loH achievement stuc!;ents are not having", 

"sufficient opportunities to respond to questions.", 
II II 

display attach references of kb. 
en<5if. 

respdistrib24: 

if LohOpp = tooloR 

and HediumOpp = toolOK 

and HighOpp = tochigh 

then <3istribprob = mediums & IohS. 

message "Your average and Iok achievement students are not having", 
"sufficient opportunities to respond to questions.", 

M II 

display attach references of kb. 
T-rk^^ endif. ^ 

ERIC 297 



if LoHOpp = tOOlOH 

and HediumOpp - toohigh 

and HighOpp = OK 

then distribprob = lowS. 

message "Your low achievement students are not having sufficient", 

"opportunities to respond to questions.", 
ti II 

display attach references of kb. 
endif . 



respdistrib2&: 

if LoHOpp = tOOlOH 
and HediumOpp = toolow 
and HighOpp = OK 

then distribprob = mediums & IohS. 

message "Your average and Iok achievement students are not having", 

"sufficient opportunities to respond to questions.", 
ti ti 

display attach reference? of kb. 
endif. 



opprespondl: 

if Opprespond_tot ge 2^ 
then opprespond = high. 

message "Students in your class appoar to have hi^h opportunity to", 

"respond to questions which is an aspect of effective", 

"teaching. ", 
ti It 

display attach references of kb. 
endif. 
\fatbook, p343 



oppre3pond2: 

if Opprespond^tot It 24 
and Opprespond^tot gt 8. 5 
then opprespond = medium. 

message "Students in your class appear to have moderate opportunities 

"to respond to questions. Increasing this amount should neip 

"your class achieve better. 
II ti 

display attach references of kb. 
endif. 
\fatbook, p. 343 



opprespondS: 

if Opprespond^tot le 8.5 
then opprespond = low. 

message "Students in your class appear to have low opportunity to", 

"respond to questions. Increasing thi.s amount considerably", 

"should help your class achieve better. Research indicates", 

"the importance of providing students with frequent oppor-** 

"tunities to respond to questions.", 
II II 

display a ch »^eference3 of kb. 
endif. 
\fatbook, p. 343 



respprobl : 

if opprespond = high 
then responseprob = absehi,. 
endif. 
respprob2: 

if opprespond ^ medium | low 
O then responseprob = present. 



ERIC endif. 
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quesprob3: 

if responseprob = absent 

and distribprob = highS 

then quesprob = highS & info. 

endif . 
quesprob^: 

if responseprob ^ absent 

and distribprob ~ highS & mediums 

tnen quesprob = highS 8* mediums & info. 

endif. 
quesprobS: 

if responseprob - absent 

and distribprob - highS & mediums & IokS 

then quesprob = highS & mediums & IokS & info. 

endif. 
quesprob6: 

if responseprob = absent 

and distribprob = none 

then quesprob = none. 

endif. 
quesprob?: 

if responseprob = absent 

and distribprob - highS & IokS 

then quesprob = highS & IohS & info. 

endif. 
quesprobS: 

if responseprob = absent 

and distribprob = mediums & IohS 

then quesprob = mediums & IohS & info. 

endif. 
quesprob9: 

if responseprob = absent 

and distribpri ^ = mediums 

then quesprob = mediums & info. 

endif. 
quesprobi 0: 

if responseprob = absent 

and distribprob = IohS 

then quesprob = IohS & info. 

endif. 

quesprobi 1 : 

if responseprob = present 
and distribprob = highS 

then quesprob = highS & info & response^opp. 
endif. 
quesprobi 2: 

if responseprob = present 

and distribprob = highS & mediu.nS 

then quesprob = highS & mediums & info & response^opp. 
endif. 
quesprobi 3: 

if responseprob = p»*esent 

and distribprob = highS & mediums 8. IohS 

then quesprob = highS & mediums & IohS & info & response^opp. 

encif . 
quesprobi 4: 

if responseprob = present 

and distribprob = none 

then quesprob = response_cpp & info. 

endif. 
quesprobi 5: 

if responseprob = present 
rUir distribprob = highS & IohS 2-^9 

quesprob = highS & IohS & info & response.opp. 



quesprobi 6: 

if responseprob = present 

and distribprob = mediums & IqkS 

then quesprob = mediumS & lowS & info & respon.^e.opp. 
endif . 
quesprobi 7: 

if responseprob ^ present 
and distribprob = mediums 

then quesprob = mediums & info & response.opp. 
endif. 
quesprobi 3: 

if responseprob = present 
and distribprob = IokS 

then quesprob = IokS & info & response.opp. 
endif. 

of 

actions: 

message "This part of SNAP evaluates whether or not you are asking an'\ 
"adequate number of questions in general (referred to in the 
"resesarch literature as 'opportunities to respond,* and whether'', 
"or not you are distributing these opportunities equitably among'', 
"students of differing ability levels. The program uses information" 
"you entered from observations 2 and 3 to determine these ratings.". 

break. 

read "obs2. dta", Successes_H, Successes_H, Successes_L, 

Opprespond_H, Opprespond_M, Opprespond_L, Opprespons_tot, 
succrate_high, succrate_med, succrate_loK, 
Responses _H, Responses _M, Res pons es_L, 
highS, mediums, lo»S, totals. 

message " First the system Fill determine your patterns of response", 

"distribution. ". 
obtain distribprob 

message "Your training needs regarding response distribution are for the", 

"follORing type( s) of students:", 
display value of distribprob. 
break. 

nessage "Mow the SNAP system Hill examine the opportunities to respond m". 

"your classroom, according to the data you have provideG. ". 
obtain responseprob. 

message "Your training needs regarding opportunities to respond are:". 

display value of responseprob. 

break. 

btain quesprob. 

message "The following list displays the areas dealing with questioning", 

"that the SNAP system believes are important to provide for you.", 
display value of quesprob. 
break. 
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Appendix L 

CJiarts of Research on 
Effective Instruction 



ERIC 
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C ATEGORy s Time Factors 



page 1 



Contttxt Variables 
<)radd BBS 



Kosenshine. 1980 

UI£S 
(tocus on 
"enijayed time**) 



2P2 



ERIC 



2 & 5 



Achieve. 
Level 



Average 
(25th to 
65X lie) 



Basic 
skills 
readlfij 
lang. art 

-fijath 



ubj. 



Teaclier Behaviors 



Reading 



Hath 



1. High effectiveness teachers 



Average effectiveness teachers 



2. Allocation of Rx>re time- 



Allocation of more tlme- 



3. when sr^atwork Is doailnant (66X reac 

teacher- leading groups 

seatwork ■ 



when amount of tim for seatwork 
Is very high (e.g. 9Qi) 



4. Teachers with highest engaged mln. 
Teachers with average engaged min. 



Outcome/Results 



Achievement 
ST LT 



Ing; 7bt outh) 



Affect 
:;chool Self 



Other 



Heldilonslup 
with other 
rosed rch 



-Time engaged: 
2nd grade: 

1 hr. 55 min. 

5th grade: 

2 hrs. 30 min 
'2nd grade: 

1 hr. 30 min. 

5th grade: 
1 hr. 55 min. 



•Increased 
engagement 
time 

•zero correlation 
with engagement 
time. 



84% engagement rat ; 

70% engagen«nt rat^ 

engagement drops » 
esp. In math 



4 min. off-task 

per hour 
i min. off-task 
per hour 



excluding time 
spent for 

transitions, house- 
keeping, etOf" 
same for high & 
ave. teachers 
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CATEGORY I Time Factors 



page 2 



Kusenshine» 19tiO 
BUS 

OJNTiNUEO 



Fuller » Becliner, 245 
Filby, HdrHdne. 

Houre» 1978 

tills 

tocu^ oil Acddewic 
learn lily tiuie- the 
dujuuiit of tiuie d 
student spends 
enydijed In an 
dCddewic tdSk that 
he or she c<in perfqnu 
Mith hiyh success. 



erJc 
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Context Variables 



BES 



Achieve, 
Level 



Average 
(25th to 
65thX 1 



le 



Tedcher Behaviors 



Basic 

skills 
-reading 
-lang. ar 
-math 



Group work having substantive 
Interactions (such as questions^ 
answers, feedback* and explanation 
Including practice and corrections 

Substantive Interactions during 
seatwork 



6. Long periods of break time (e.g.» 
recess » 1unch» bathroom} 



O ptlmuiP behaviors: 

1. High aR»unt of time allocated to 
;s Instruction in a content area 

(process-product correlation) 

2. High amount of time allocated to 
instruction accompanied by high 
auiount of student engaged time 

(process-product correlation) 



Outcome/liesulta 



Achievement 
ST LT 



high achi 
fiient 



Affect 
'ichool Self 



eve- 



Other 



Increased engagement 
during seatwork. 



Increased engagemt 
during seatwork 



nt 



Decreased engaged 
Ime- "play" seem^ 
to carry over and 
disrupt engagement 
during "work" 



Relcxt lonship 
With other 
resc'arch 



Criticism: 
ALT as described 
largely Ignores 
the relationship 
between learning 
and ALT. 

Griffin. G.A. Webb 
N.H.I & Confrey>J. 
Time to learn 
reviews from three 
perspectives. The 
Elein. Sch. J.> 
*SeptrV9*8l776-9l. 
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CATEGORV: Time Factor 



Page 3 



Heterence 



irade BBS 



bTES contc 



Context Variables 




2^6 



Achieve. 
Level 



»ubj . 



Teacher Behaviors 



3. High amoung time provided 
for performance of skills task 
where there is high level of 
success, (procecs-product 
correlation) 

And 

4. Low success relates to 

5. Amount of allocated and en- 
gaged time 

And 

Provision of high success rate^; 



Optimum behavior; 

6. High diagnostic accuracy 



Optimum: 

7. High lever of matching 
instruction with needs and 
skill levels of btudents 

Optimum; 

8. High amount of time given ta 
substantive interaction (See 
Rosenshire, 1980-BT£S-on sub- 
stantive interaction) 

Optimum: 

'9~ High amount of time given 
academic feedback (process- 
product correlation) 



OutComa/Besults 



Achievement 
ST LT 



High 



Lew 



Affect 
School Self 



Hi 



generally high 



Hi 



gh 



gh 



NR 



somewh tt 
higher 



Other 



High Student 
engagement 



High student 
engagement 



High student 
engagement 



Relationship 
with other 
research 



2^7 
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CATEGORY : rimt^ v^ntarfi 



Hef erence 


Conte 
iraUu 


xt Va 

SES 


riables 
^chievo. 

ttiVtil 




Teacher Behaviors 


Ot 

Achiov 
ST 


it;come/ 

^ement 
LT : 


Results 

Aff 

ichool 


ect 
Self 


Other 


Relationship 
with other 
research 


Kiblict t et ai • , 
197a UTES conLd 
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Optmum: 

10 • High amount of providing 
direction and discussing 
structure of lesson 

Not Optimum behavior: 

XX. High amount of explanations 

given to expressed student-neec 

Not Optimum behavior: 

12. High amount of reprimands 

Optimum behavior: 

13. High academic goals - emp- 
nasis on tne imporcance ot 
school learning 

Not Optimum for student achiev- 
ement : 

High orientation toward affec- 
tive outcomes 


High su 
rate 

fewer h 
success 
and mor 
success 

low 
high 

low 


:cess 

Lgh 
tasks 

i low 

tasks 






Off task be- 
havior task 
difficulty-higl 

Less allocated 
time for skill 
instruction 
Lower engageme 
rates 

Lower success 
tasks 


i 

It 

2^9 



I 



CATEGORY: Time Factors Page 5 



Heterence 



Coiuext Variables 
' ^ Level 



Kibhes t et al • « 
*9 7a UTES contd 



4 bto|ihy« 1*^80 



ERLC 



3^0 



7/8th 



iQixec 
rac i 
eth 
back 
grou 



>UDj . 



mixed 



matb 



Teacher Behaviors 



Opt*c^um behavior; 
14. High provision of learning 
environment characterized by 
student responsibility for 
academic work and by coopera- 
tion (with other students) on 
academic tasks* 



CharacteristAcs of effective 
teachers; 1. at least half of 
each period -lecture, demo, & 
discui.sion. 2. Less than half 
period - seatwork. 3. Less 
transition and group discipline 
time than in classes with less 
effective teachnrs. 4. More 
time spent on b^^sic concepts 
than in classes of less 
effective teachers. 5. Did not 
presume on high le^cl of prior 
knowledge among students. 
6. Enforced rules - low anxistv 
high confidence, high task 
orientation, high enthusiasm 



Outcome/hesults 

Affect 



Achievement 
ST LT 



high 



jichool Self 



Other 



Relationship 
with other 
research 



Observers sco- 
red teachers on 
classroom obse 
vation scales 
and rating sc- 
ales effective 
teachers were 
significantly 
high . 



3 



n 
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Hcterenca 



leview of 



^odi:, 1973 



StaUings k 
Kat>koUitz, 1974 
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Context Variables 
Achieve. 



1-3 



1-2 



(elen) 



low 



low 



low 



low 



low 



Level 



Hath 



Math It 
English 



Math 6 
reading 



Reading 



Math 



Teacher Behaviors 



Characteristics of effp ctiv5 
teachers; 

Direct instruction - more than 
in English classes 

Use their knowledge of students 
skill level 

Try to create a learning envir- 
onment that is most effective 
for each student « 

Characteristics of effective 



teachers; 

More time for task-related 
or academic activities 

Structured time on low and higt 
complexity tasks 



Effective teachers ; 



Low time spent discussing 
matters unrelated to content of 
lesson 

High total academic verbal in* 
teractions 



High total academic verbal 
interactions 



Outcome/Results 



Achievement 
ST LT 



gai 



gaiis 



gains 
comp 1 e 
perf or 

gains 
and hi 
compl 
perf or 



e< 



Affect 
$chool Self 



IS 



in low- 

<ity 

nance 

n low 
[jh- 
ity 
nance 



Other 



Relationship 
with other 
research 
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Reference 


Coatti 
U'ade 


xt va 


riables 

\chleve* 
Level 


>ubj • 


Teacher Behaviors 


Oi 

Achiev 
ST 


itcome/l 

rement 
LT i 


Results 

Aff 

ichool 


ect 
Self 


Other 


Relationship 
with other 
research 


Cent la k Put lei 

icvicwts on mode 
tor tliVct>LigaLl 
:*oliaul 4 tcache 
Variables which 
influence stu- 
dent achievemen 

StallingSf 1976 

Ricttii polsgrov 
U Scmueli 1981 
research review 

ERIC 


I 

r 

t 

1-3 




Regular 
Kducd 


Reading 
k Hath 

Reading 
k Hath 

)nd Spec 4 
Lion 


Increased time in school 

Increased time for other 
e:ctivities (art, etc) 

Increased school day 

Higher correlation between 
engaged time and student 
achievement than between 
allocated time and achievement 

Direct instruction 
Advice for minimizing trans- 
ition time: -present instruc- 
tions clearly -instructing 
groups away from rest of class 
-preparing materials before 
buginning of class 


higher 
lower a 

higher 

maximize 


achieve 
:hieve« 

J ALT 






Student engage- 
ment depends ot 
how allocated 
time is used* 


3^5 
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iielerence 


Cont€(] 


(t Vai 

S£S 


ciables 
Level 




Teacher Behaviors 


nil 

Achiev 
ST 


(rvome/r 

eroent 
LT i 


A 0 1 1 1 ^ o 

Affc 
chool 


5Ct 

Self 


Other 


wiLh OLher 
reBiiurcn 
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4th 

Boys 

jr-sr 
nigh 

jr. higi 
jr. higt 


ulxed 


"good" i 
"poor** 


reading 


Students working with teacher 
Students working Independently 










On^Jdsk: 

gooTrdrs: 92% of 
the time ' 

poor rdrs: 83X of^ 
the time 

good rdrs: 89% of\ 
the tlute « 

poor rdrs: 83X of 
the time 

good rdrs more on 
task during 
instruc. time 
than poor rdrs. 


• no diff. for on 
/^task behavior 

does not support 
finding of Soar, 
1973; Stall ings 
& Kaskowitz, 1975 
That s. are more 
on task when with 
teacher 




8 oiajor 
areas 


Provision of appropriate materials 
and content 

1?irge classes, late classes, and 
young&r students 

(ipper curriculurit track 
classes with oore females 










relates positively 
to the annunt of 
time stidents 
work alone 

Teachers spend mo 
time on students 
behavior 

teachers spend les 
time on students 
behavior 

teachers devote 
more time to 
instruction 


*e 
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< jCdde EES 



frouiner, Evert 
i Afiderson. 



on 



Co»t5er i Hi neb 
19a2 



erJc 



30 



Context Vari«blefi 



3rd 



6-12 



8 



achieve. 



ly 



ubj. 



Teacher -Behaviors 



Effective classroom tnanagement: 
[fDore tline explaining and reminding 
students of the rules] 



Ind.* Arts 



0ut;9omeyHe8ults 



Achievenent 
ST LT 



Effective Classroom inanagement: 
"down time** kept to a mlnlmuen 

very little classtlme Is spent 
with an Individual student* esp. 
at the beginning of the period 

high uioblllty during the period 



monitoring of potential trouble spo|^s 
with rapid, low threat Int. when 
trouble arises 



Affect 
jichool SeZf 



Other 



Hfi.it iiiii:.lili< 
wuti otiit-l 



all activities: 

on tas'naexy 

niore than In 
classes of less 
effective managei}s 
(75X) 



Con tent activities 
on tasFle^tr 
foore than In 
classes of less 
effective 
iranagers (59%) 
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Lt VdX 

>ES 


iablds 

ichieve. 
Level 


ubj. 


Teacher BehAVioce 


QUI 

Achieve 
ST 


fCome/H 

^ment 
LT i 


esults 

Afft 
chool 


tct 
Self 


Other 


WUll (iUic't 


Clioii. ThotaaS. 
Thuiu, Qody» & 

ERIC - 


5th-6th 

tegular 

& 

Wlnstre^ 

) 


ethnic 
bdgd 
Mixed 
med 




math 


Opportunity to learn: 

Designated time In academic area 
(I.e. math) . 

Provision for engaged time 
t^rovlslon for high success 

as class size Increased* more time 
was spent on classroom management 
than on dcademic acttvltles- 

But 

class size did not relate to studer 
engageaiont or tlaie on success tasks 
Huater of LO In class-no relationship 

Direction Instruction 


t 








67% oppcrtunlty to 
learn out of 
designated time 

22% of time on non 
academic actlvltl 

malnstreamed; 1/3 
the amt. of high 
success time as 
regular students 

younger & female 
students had more 
high-success time 
than older & male 

Inst reamed 
students- not 
paralleled with 
regular san^le 

no affect on succe 
on tasks 


^S 

ss 
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page )) 







It V4S 

>£S 


achieve. 




Teacher Behaviors 


Ou 

Achieve 
ST 


|,CoroeyH 
LT : 


dtiulca 

Afft 
chool 


iCC 

Self 


Other 


lit: l.U tiJlittlil |« 

with uiiiet 


Wync i Stuck, 
1982 

Keview of tliue- 

<in(i*le<irniny 

resedrch 

312 

ERIC 










\ primary characteristic of effective 
instruction Is teacher behavior that 
leads to high tine on task 

Implications of time-and-learning 
research should be viewed In 2 
categories: 

-oppertunlty to learn 

-quality of Instruction 

(They list 11 specific lu^Hcatlons) 












Problems w/oiost 

timc-and-learnlny 

research; 

-QX)St Is 

correlational 

or descriptive 
-time Is not 

uniformly 

defined 
-very small 1 of 

controlled 

studies 

i 
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page 1 



He^erence 



< trade B 



Ooyle, 1977 



secondaiy all 
'muUldlnenslchalf ty of 
classrqom Interactions] 



nrophy, 1982 



Eniner et al. 
EP 226 451 
£0 226 452 
(2 studies) 



1981 



ERIC 3t4 



Context Variables 



Despite 
student 
abintl 



one- 
jr. hl4h 



BS 



achieve, 
Level 



diffe 
backg 
s] 



ences of 
^unds and 



mlxec 



5 Basic Techniques ; 



English 
^th 



Teacher Behaviors 



Chunk^ig events Into larger unit 

2. Differentiation- discriminating 
' the significance of events 

3. Overlapping - handling 2 or more 

events at once 

4. Timing- monitoring or controlling 

duration of events 



High expectations for students* 
-achievement 
-behavior 

l\cceptance of responsibility for 
students' growth 

^Igh amount of planning 

iuslness-like and task-onlented 
lassroom structure 



Management Techniques ; 



-clear & realistic expectations 

centered on routines 
-establishing rules at beginning of 

year 

-reinforcement of rules 
-high level of planning 
-teacher In charge at all times 
-content focus & accountabllUy system 
- Soliciting personal Info, begin of year 



Outcome/Besults 



Achievement 
ST liT 



Affect 
School Self 



Teachers viewed as 
"successful** 



Other 



Hig*- le-el- of 
work Involvement 
and low disruptio 



Relationship 
with oi.her 
research 



High levels of tds|k 
engagement and 
appropriate behav1)3r 
tow levels of 
disruptive or 
Inappropriate beh. 
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»eference i Context Varidblea 

Achieve. 



< irade B 



Guthrie. 1982 



Epdns» 1983 




316 



ES 



Level 



Teacher Behaviors 



Good Hanaqeaent; 



-long«>teni solut1on*orlented 
.pl4nn1ng 

-clear cosnunlcatlon of rules 
which were taught at beginning 
of year 

-qonslstent relnforcenent of rules 
-problejRS are prevented 
-behavior Is nonltored 
-^Inappropriate behavior Is stopped 
before It Is seriously disruptive 



Basic 
math and 
reading 
skills 



Direct instruction characterized by 



active teaching^ 
-teacher sets clear-goals and 

Involves all students 
^•sufficient and continuous tliDe 

allocated to learning 
-loaterlal Is covered In snail step 

at rapid pace 
-questioning at low cognitive 
level 

-teacher nonltors students & 
provides lovsedlate feedback 

-atmosphere Is structured but not 
authoritarian 



Qutcome/BdsuUs 



Achievement 
ST LT 



Affect 
l^chool Self 



Othe: 



slallar to 

outcomes 
of Enroer 

et al, 
(1981) 



Belat ionship 
with other 
research 



3^7 



A 
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Reference 



Rosenshlne^ 1983 

Review of studies 

Note: See outcoo)^ 
other 



Souster. 1982 
ED 222-468 



er|c 
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Context Variables 
rade BE3 



eleu. 
jr. hig 
sr. hIg 



6th 



achieve. 
Level 



Low 



Mixed 



ubj. 



Language 

Hath 

Reading 



Language 

Hath 

Reading 



Teacher Behaviors 



Direct Instruction In 6 Instructional 
Functlon'sV 

1, Review of previous material 

2. Denonstratlon of new content 
. and skills 

3« Guided practice and checking 

for understanding 
4«. Feedback and corrections with 
reteaching If necessary 

5. Independent practice 

6. Periodic review at regular 
Intervals 



Indirect Teaching 



Indirect Teaching and Combination 
of Direct and Indirect stjtles- 

Kote: ••Indirect" and •'direct" were 
not defined 



Outcoroe/Besulte 



Achievement 
ST LT 



Affect 
iichool Self 



tLang. 



Mang, 
^inath 
(-reading 



Other 



Teachers 
Istpleiaented 
pattera of direct 
Instruction 
••successful }y** 

Teachers have 
some difficulty 
In phase of dlredt 
Instruction which 
requires concept 
development by 
students 

*Roeh1er & 
Duffy, 1981 

-Good & 
Grouws« 1979 



Relationship 
with ot:her 
research 



Does not 

support 

findings 

of high 

basic 

skills 

achievement 
with direct 
Instruction 
and lower 
achievement 
with Ind. 
Instruction 
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Heference 



irade BES 



Peterson, P.L.^ 
1979 

Review of studies 
comparing open 
dnd traditional 
teaching styles 



el em. 
Jr. higJ 



Medley, O.H., & 
Crook, P.R. 

Late; 1980 
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Context Variables 



Achieve. 
Level 



ubj, 



Traditional styles (direct Instructloi 
coepfired to open teaching styles 



Teacher Behaviors 



'Open Teaching** con^ared to tradition 
style 



Iroportant Teacher Tasks; 



1, iftalntalning students* task- 
Involvement 

2, large grqup» teacher*student 
recitation about lesson content 

3, nlnlotlzlng disruptive pupil 
behavior 

4, managing small group activity 
(difficult to do well, so teachefs 
observed as "effective" usually 
are 'not observed conducting 
small groups) 

5, supervising pupil seatwork 

6, structuring a large portion of 
pupil time 



0u|;come/8esult8 
Achievement | Affect 



ST 



slightly higher 
achieve ntent 



cf 



but 
tests 
abstracit 
thin 

as creajtl 
and , 
solving 



LT school 



9 

on 

nore 



» such 
vity 



lower 0 1 
achUveient 
tests » >ut 
higher in 
creatfv ty $nd 



problem 



high amount of 
learnin 



solving 



Self 



see Achievement 



Other 



see Achievement 



Relationship 
with other 
research 



Her review 
Includes 
comparison 
with 

Horowitz's 
review & 
offers 
criticism 
of his 
methodology 
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page b 



Deference 



< irade 



Annento. B.'. 1977 



Anderson, L.U. i 
Scott » ex., 
1978 



They equate high 
students involvement 
with high teacher 
effectiveness 



ERIC 



Context Variables 



BES 



high 
school 
(9-12) 



"subur 
ban" 
H,S. 



Achieve. 
Level 



( s 



2 Subsampl 
APT-scholai 
aptitude 
ASC-academ 
self-conceit 

1. High 
Apt. 
High 
ASC 



high Apr 
l ow ASC 



2.6)ed apr 
high ASC 



loed apr 
low AS & 
low ap7 
high ASq 

3* low aot 
low AsC 



social 
science 



human 1 
tic & soc 
science 



tjies (Stu^y of Student Involvement In 
al learning) 



Teacher Behaviors 



Effective Teachers Demonstrated; 



1. Accuracy of concept examples 

2. Relevance of behavior to 
■ objective 

3i Balance between concrete and 

abstract terminology 
4% Reviews and sunxnarlzes main 

Ideas 

5. Expresses Interest and 

enthuslasn over lesson content 



Qutcome/Besults 



Achievement 
ST LT 



Affect 
school Self 



(post tes^ was 
Inamedlately 
afterward) 

+ 

+ 





Audio-visual presentation 
lecture 

classroon discourse 
seatwork 
groupwork 



whos 
teachln) 
tiost 
c^twork. 
to 

1 group 
t differ 



audio-visual 
lecture 

classroom discourse 
seatwork 
groupwork. 



rpom d1sc()urs 
In hete 



classroom discourse 
seatwork 
lecture 
audio-visual 



Other 



( w 



i task Involvement 
method was the 1 
Involved through 
High APT, high AS( 
different methods 
fork setting. Different 
ntly In different 



e method appear 
ogeneously groupec 



Relat ionship 
with other 
research 



was most affected 

APT-low ASC group 
lassroom discourse 
also responded 
and were most off- 
students 
situations. 



; to be most useful 
classes. 
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Hef erance 



< irade BES 



Context Variables 



Vchieve. 
Level 



lUbj, 



Teacher Behaviors 



QutQome/Besults 



Achievement 
ST LT 



Affect 
school Self 



Other 



Relationship 
with ottier 
research 



Farnsworth, 6.J.» 
Da1nes» 0.» 1978 



writing 



Orophy. 1975 
Texas Teacher 
Effectiveness 
Study 



2-3 



low* 
low- 



high- 
high- 
low— 



lilgh- 



Indep. variable: Cognitive level of 
teacher's Instruction 



Writing perforwan^e Hot to be viewed 
In contradiction 
of basic skills 
research which 
on recommends lower 
el cognitive level 
teaching at this 
grade* 



the higher the 
teacher's cog* 
level of Instruct 
the higher the le* 
of students' 
perfonnance* 



Effective Teachers 
more structure and were more restrictive 
than teachers of high SES students 
high expectations comsunlcated througl 
warothi supportlvenessi pat1ence» and 
encouragement 

form of structure provided more 
opportunities for students to work 
Independently 

high expectations were corrcnunlcated 
through challenge and critical 
demandl5igness 

isiportant for teachers to make sure 
children got assignments they could 
handle and to make sure assignments 
were completed 

environment needs to be stimulating 
and interestina 
teacher enthusiasm & verbal preparatioli 
with students not important with youngj 
children . 

indirect teaching inappropriate in 
early elem grades 



high 
on s 
tests 



ains 
tandardl2^ 



3^5 



r 
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Kef orence 



Context Variables 

X J Achieve, 
tirade pES (Level 



Cvertson» 1980 



Evertson* Sanford 
& Qrophy* 1980 



ERIC 



Jr. Mgi 



Jr. hig!i 



low 



math 



math 



Teacher Behavlora 



Lecture phase of lesson In preparatloi 
of seatwork Included brief, highly- 
focused seatwork activities. Long* 
extended seatwork activities were 
avoided. Teacher closely monitored 
seatwork* lanedlate feedback for 
seatwork. Whole class presentation 



OutC^ome/RoBulta 



Achievement 
ST LT 



high percentage of tiine teaching whole 
class 

Alnost all class discussion Involved 
v^hole class* 

High percentage teaching subgroups 
Preference for lecturing 
ll1gt< expectations 

Teacher preferred fairly structured 
classroom environment & accepts 
personal responsibility for cianagement 
& discipline 

Teachers believed that they can do 
little about discipline problems 
Teachers weri» reluctant to rely on 
Lext 

, requent homework 

Teachers assumed that students would 
:nJoy lessons without special dressing 



Affect 
i;chc j1 Self 



-(teac 

-(-) 

+(for 

-Cfor 



+ (tec Cher) 



low 



+ (tea:her) 



high task 
Involvement 
low disruptive 
behavior 



level (t 



Other 



her) 

high lev^l (teacher) 
low level * 



:acher) 



Relut lontihip 
with ottier 
rescurch 
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Koference 



irade BBS 



Evertson» Sanford 
& Brophy, 1980 
(continued) 



Jr. higli 



Good & GrouwSv 
1979 

4. of Ed. Psych. 



Context Variables 



4th 



Achieve. 
Level 



low 
urban 



lUbj. 



En^Jish 



math 



Teacher Behaviors 



Teachers preferred formal . more 
traditional classroon environment - 

Teachers demanded attention to 
directions. Students took responsibil 
for work. 

Teachers used text« peer tutoring^ 
reading aloud slowly* reviewing 
iirections carefully and slowly. 

)rill and boardwork- new material 
I checking comprehansion tests 

iigh % grades based on objective 
vidence 



Key Instructional Behaviors: 



1. Daily review 

2. Concept development 

3. Seatwork with monitoring and 
feedback 

4. Homework assignment 

5. Speci&l reviews 
-weekly (each Monday) 
-monthlyievery 4th Monday) 



Outcome/pesulte 



Achievement 
ST LT 



ty 



Affect 
school Self 



+ 

-high 
-low 



(bi 



+high 
-low a 



ability 
lity 



ability 
bility 



+high 
-low 



a^il 



abil 



Other 



Ity 
Ity 



Relationship 
with other 
research 
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Heference 



Context Variables 
irade BBS fgi^J^' fubj. 



Euioer, Evertson» 
& Anderson » & 
Brophy. 1980 



Orophy, 1983 



ERLC 



330 



low 
Diddle 



Teacher Behaviors 



Effective Classroom nanagement^ with 
beginning of the year behaviors rated 
high as predictors of later behavlcr 
dnd orgarlzdtinn ; _ ' _ _ 



Effective stanagers had: 

1. workable system of rules and 
procedures which they taught 
their students In first weeks. 

2. careful monitoring of students 
with careful directions 

3. Control over Inappropriate beh. 
stopping It sooner than less 
effective managers 

4. predictability and credibility 
among students because 
consequences of appropriate and 
Inappropriate behavior were clear 
and consistent 



Success Rate & Instruction: 
Desi red for ef fectiveness 

Teachers who monitor responses and 

provide feedback 

Students working alone or doing 
seatwork and homework 



Oufccome/Bdsults 



Achievement 
ST LT 



'Associated 
student 



-Good & 



Affect 
jichool Self 



with 
earning 



Grouws 
1979 



Other 



high student 
engagement time 



Desired for 
effectiveness: 



70-80% success 
rate 

95-lonX success 
rate 



?ielat ionship 
with other 
research 
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Heference 



irade 6ES 



Slavin, 1980 
Rev. of research 



Context Variables 



Achieve. ^ 
Level 



iUbj. 



(novfledge 
ca1cu1at1( 
reading 
appl. of 
skills 



Teacher Behaviors 



Cooperative Learning in Teams 
-effective for Increasing achievement 
varies with approaches 



-some evidence suggests: 
Group-Mastery methrds 



identifyi 
concepts 

analyzing 
problems 

(naking 
and eval. 



Jut 9 



Group-Investigation methods 



!Rore 

low-level 
outcomes 



Outcome/Results 

Achievement I Affect 
ST liT $chool Self 



effective for 
learning 



nore effec 
Higher ord 



ive for 
r skill 



Other 



Relat ionship 
with other 
research 
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Hef erence 



Context Variables 



Peterson, P.L.» 
1977 

ATI study 



ERLC 



3:^4 



rade BBS 



ethnic 
mixed 

[1/2 
blue 
ollar 



\chlev6. 
Level 



tlly 



Atxiety 



Ability 



high anxiojs 



high abili 



high dnxioi s 
low abiliiy 



soc. sci. 



ty 



low anxious 
high ability 



low anxious 
low ability 



Teacher Behaviors 



Structuring and participation 



structuring; 
goals 

verbal laarkers 

transition signals 

advance organizers 

sufisnarles (by tchr/by students) 

reviews (by tchr/by students) 

previews 

participation ; 

questions-tchr & students 

redirections 

use of student ideas 

students remarks 



0u1;come/Besult8 



Achievement 
ST LT 



(ATIs wer 
sign1fic(int 
ST than 



Affect 
ichool Self 



more 
in 

T) 



Kult.Ch 
Essay-sIm 
results 
worst In 

low part 
equally wdll in 

other 3 treatment 



i nd 
lar 

ow strud/ 



lEies't in Iqw struc/ 

low part, 
worst in high strijc/ 
Jaw-P^r.tt. 



best in low struc/ 
low partJ 

worst in row struc/ 
high par 



best in hfgh strudi/ 

low part J 
worst in pow strud/ 

low partj 



Other 



Student Attitude: 



consistent trend 
indicating 1nstru{:. 
treatments with h ^ 
achievement outccijies 
correlate with 1o^ 
student attitude 
toward treatment 
vice versa. 



Reldt ionship 
with other 
research 



gh 



nd 



CATEGORY i Ips^r^ctlonal Approaches 



page 12 



Hef erence 



Mrade BBS 



Peterson, 1977 
continued 



ERLC 
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Context Variables 



Indi 



Achieve « 
Level 



pender 



5ubj» 



ce-Conformi 



Independenjt 
students 



conforming 
students 



conforming 
students 
low on total 
notlvatlon 



independent 
students 
f)igh on 
total 

notivatlon 



Teacher Behaviors 



Instruction allowing students to choo: 
their own achievement strategy, e*g«» 
low struc/low par« or high struc/high 
par* classes 



Instruction providing clear strategy 
to which students could conform, e*g« 
high struc/low par* 



Instruction providing the one clear 
strategy as conformance to teacher 
structure* 



Instruction providing low struc/low 
par* 

Instruction providing high struc/ love 
par* 



Out;com6/Besult8 



Achievement 
ST liT 



e highest 



highest 



highest 



highest 
lowest 



3 



Affect 
lichool Self 



but 

differ* 
was sma 



Other 



Relationship 
with other 
research 
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CATEGQRy< Instructional Approaches 



page 13 



Reference 



irade BBS 



Peterson & Jamlcki 
1979 &1981 
(same study) 



3^8 



er|c 



Context Variables 



4-6 



Level 



)Ubj« 



math 



high ablll y 



low ability 



students 
who preferijed 
small qrps. 



students v^io 
preferred 
large grp 



(In small grps* higher abll. students 
helped lower abll. students) 
s mall group Instruction coinp- to 
"large group 



Teacher Behaviors 



Leam1n9 In Large-Group and Small- 
Group Approaches : ^ 



large group Instruction comp. to 
small group 



Small grps. comp. to large grps. 



large grp. comp. to small grps. 



Outcome/Results 



Achievement 



Affect 



higher 



higher 



lower 



lower 



Other 



Attitude tow. ipatli 



higher 



higher 



Relationship 
with oilier 
research 



Contradiction of 
Rosenshlne's 1979 
findings saying 
that large group 
Instruction Is 
more effective 



4 



CATEGORY I Instructional Approaches 



page 14 



Heference 



irade 



Webb, 19B0 



er|c 



340 



Context Variables 
Achieve, 



5ES 



11 



Level 



high 



middle 



ubj. 



math 



low 



Teacher Behaviors 



V-thlevesient In Group Work 3 Phases: 

1, Teacher gave 1f:$truction for 
math skills 

2. Students worked In groups to 
solve math problesn* They had 
"to put together the co»pon&nt skills 
taught to everyone by the teacher 
Jhey were encouraged to ask ques. 
of teai^nutes and to explain to 
one another, 
(controls were not placed In grp<]«) 

3« Testing (Individual) 



Outcome/Results 



Achievement 
ST I LT 



Affect 
;;chool Self 



iiigh perfo 
related to 
to low stu 



success 
inferring 
level stud 



tigh p6rfo[inanc6 
related to 
xplanati 
ilgh studejits 



loance 
explain 
ients 



related to 
with sarte 
nts 



recelvlijg 
froai 



ng 



Other 



Relationship 
with other 
research 



Further research Is 
needed to examine 
relationships 
between ability and 
personality 
variables* 
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CATEGORY t {nst r uctlnnal Apprnarhe^ 



page 15 



Reference 



Mrade BES 



Uebb, 1982 



o 342 
ERIC 



Context Variables 



7-8 



\chlev6. 
Level 



3bove ave. 
classes 



ubj. 



inath 



Teacher Behaviors 



Achievement In Group Uork 
3 Phases 

1. Tchr gave Instruction for math 
. skills 

2. Group work (see Webb» 1980 p. 14) 

3. "ndiv, testing 



Outcome/Results 



Achievement 



ST 



LT School 



Affect 



Self 



Other 



Relationship 
with other 
research 
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CATEGORY; I fiStnf<^t1»"^^ Appmarhpc 

• 



page 16 



Heference 




Context Variables 




lUb j • 



Teacher Behaviors 



Achievement 



Outcome/Results 



Affect 



Other 



Relat ionship 
with other 
research 



ST 



LT 



school 



Self 



Roehler & Duffy, 
198] 



Effective Teaching In Elem, t 



Too often effective teaching Is 
seen as effective classroom 
sjaridgeinent 

-use of direct Instruction 
-high titRe on task 
with teachers looking like tech. 

What Is needed In Tchr. ed.: 

1. Illumination of the complexity 
of classroom life 

2. Approaches to help tchrs 
explicate w/clarlty and provide 
prompts to assist students' 
learning 

3. Kelp tchrs use Instructional 
material In ways that help 
students learn. 
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ERIC 
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CATEGORY : Planning 



page 1 



Hef erence 



(frade 



Trahdn» 1979 



Virginia State 
Dept. of Ed. 



Shavelson & Bor't 
1979 



Clark & Yincer. 
1979 

(3 studies) 



o 346 

ERIC 



Context Variables 
Achieve* 



elm 
urBan 
rural 
and 

suburba 



ES 



Level 



>ubj< 



Teacher Behaviors 



Planning Is "the foundation upon whid 
all effective Instruction Is based; 



Effect. Tchr. plan a "controlled 

learning environment: 
Planning should be In 4 parts: 
1. what the students should learn 
2*. bow Instruction Is to be 
delivered 

3. when and how the different 
learning activities will be 
conducted 

4. the time-line and grouping 
arrangement for instruction 



The timing of questions may be more 
important than the freqi'ency of 
asking. 



Survey of Elem^ 
Findings: 



Teachers 



K Learning objectives are usually 
not the starting point of planni 
usually planning is around 
students activities 
2. They tend to limit their search 
for ideas to resource that are 
immed* available* e.g.» manuals 
f11ms» magazines 



Qut;come/R6BUlts 



Achievement 
ST LT 



Affect 
school Self 



Other 



more time-on-task 
w/ higher achievetd 



He till lOl»:»hll* 
With otiiel 

ro^ic'u I ch 
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CATEGORY; Planning 



page 2 



hef erence 



Clark & Ylnger, 
1979 

continued 



Context Variables 

^ry^ Achieve* 
rade BES ^^^^^ 



1. cont 



nued 



2« upper 




348 



elein 



ubj< 



RX)st planning Is for rdg & lang 
arts«» then mt^t, social studies, 
and sclenoe 

teacher planning Is more explicit a{id 
Involves longer lead times in team 
teaching than In self-contained 
5. inost coflmon form of planning was 
outline or list, but some reported 
that all plans were In memory 
plans seefned to provide teachersw/ 
psychological benefits (e.g. security) 
not Just as a means of organizing 
Instruction 



Teacher Behaviors 



aboratory Study of Teacher Judgment 
. In Planni ng 



process tracing suggests 4-step 
process 

1. att(«ipt to urderstand the 
activity 

2. Imaglrnlrig use of activity 

3. lhii.l.1ng of ways to nidify or 
adapt to avoid pitfMcns 

4. creating mentdl Image of revised 
version of the activity 



Qutcome/Results 



Achievement 
ST tT 



Affect 
School Self 



Other 



WUh Ot ltd 

research 



■^4,9 



CATEGORY i Planning 



page 3 



Cldrk & Yinger 
1979 

continued 



Cldrk. 1983 



Context Variables 



ERIC 



£S 



Achieve* 
Level 



ubj. 



Teacher Behaviors 



Field Study of Teacher Planr'lng and 
plan Irnpl eirentatlon 



Outcoroe/Bosults 

Achievement 
ST LT 



(This W£s a longitudinal case history 
of a plan) 

what they found In this approach 
fit well wtth findings of Lab. stud^ 

Kinds of Plarners: 
L Incremental planners 
-brief prob-flndlng stages 
-brief unit pUns 
-short planning steps using day- 
to-day Info. 

2. coiwrehenslve planners 
-weil-deflned framework for 
future action 

-specify plans before teaching 
-plan by uni ts ^ 



TeacSrts who are prt>f111c planners 
-not prolific planners 




Other 



tie hit ioiishti» 
with ol.tiet' 
reut'uich 
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CATEGORY! Plannina. 



page 4 



Keference 



qrade 



Shavelson & 
Borko, 
1979 

Review of reseaHh 
f( (MTsentatlon 
of inodul 



Context Variables 

\chieve. L 



Bowermdster, 19B] 
review of research 



er|c 
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ES 



Level 



jubj. 



Teacher Behaviors 



Outcome/Results 



Several factors affoct Ic&claTS 

decisions about plannlmj: 
-slui^trtt characteristics 
•teachers educational beliefs 
. and cognitive styles 
^nature of Instructional taik 

Factors whkh should be considered 
In planning process 
-students* achlevetaent 
-their class participation and 
work habits 

-aiQOunt of cooperation between 
students In class 
-problejsatic classroon behaviors 



Planning characteristics for xnro 
effective teachers; they: 

1« plan ahead 

2. fornulate rules and procedures 
early In year and give clear 
explanations to students 

3« have established procedures 
relating to Instruction 

4. plan for unusual situations 

5« nave plann for acquiring 
materials 

6. have planned their room 
arrangements 

7« plan early morning activities 
to Include ones which are 
ea^y to focus one's attention 
and to participate In 



Achievement 
ST LT 



Affect 
:;chool Self 



Other 



Relat ionship 
with other 
research 



CATEGORY i Planning 



page 5 



Heference 



irade 



6rlffln» 1983 



ERLC 



354 



Context Variablefi 



ppjj Achieve, 
Level 

fi 



Teacher Behav.iora 



Studies of planning and decision- 
Kaking are f^w 
Research In the area has oethodologi 
problefits 

A need for research linking teacher 
decisions to student learning 



Qut^come/Besults 



Achievement 
ST LT 



cal 



Affect 
school Self 



Other 



Rdldiioiiiship 
with oiiher 
research 
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CATEGORY : Knowledge and Training 



page 1 



Heference 



irade 6ES 



Context Variables 
Achieve. 



Level 



Teacher Behaviors 



Outcome/Hesults 



Achievement 
ST LT 



School 



Affect 



Self 



Other 



Relationship 
witti other 
reseai'ch 



PdVdIko. 1970 



Schlechty & 
Vance » 1983 



356 



Studied recruitment^ selectlont & 
retention of teachers: 

After 3 years- 

lowest ability undergrad. 
remained 

56. 7X- middle ability undergrad. 
remained 

S9.)»- highest ability undergrad. 
remained 



no evidence that people w/oraduate 
degrees are more proficient teachers 

schools which engage teachers in Job- 
related discussions and share In 
dec1s1on*mak1ng re Instructional 
prograas 



confirmed by 
larrlson. 1976 



these schools are 
more effective 
than schools which 
do not Include 
teachers In decision- 
making. 
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CATEGORY; ICnnwIerfg^ r^ncj Jralnipg 



page 2 



Reference 



< irade BBS 



Brophy* 1976 



Brophy, 19/9 



Joyce » 1978 



Joyce, 1982 



Context Variables 
\chieve* 



K-3 



Level 



Teacher Behaviors 



Teachers should have specific tralnlnj 
for their use In lower grades where 
basic skills are stressed 



To Ifnprove effectiveness, teachers 
need to: 

become 6X>re proactive In their 
olanning 

engage In peer observations and 
conferencing 



Effective teaching requires: 

a variety of methods 

training to help teachers learn 
different approaches- & when to 
use them 



Coaching by peers enables teachers 
to transfer new teaching modelr to 
their active repetolre. 



Outcome/Results 



Achievement 



ST 



LT school Self 



Affect 



Other 



Relationship 
with other 
research 
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CATEGORY : Knowle dge and Training 



page 3 



Reference 



Mrade 



Context Variables 



BES 



Vchieve. 
Level 



)Utj. 



Teacher Behaviors 



OutQOfse/Results 



Achievement 
ST LT 



Affect 
School Self 



Other 



Reladonsliip 
with at: her 
re^search 



Thompson, 1980 



HiHer, & Elisor 
1983 



ERLC 



360 



Teachers phlllsopMcal beliefs are an 
fnportant aspect of ttieir decision- 
naking re teaching methods- 

Reconmend Riore attn, to ed, phlK 
in' ed, training 

Teachers make decisions about tnethods 
3ased on concern for basic skills, so 
sasic skills Issues should be Includec 
in training of new tnethods. 



Inservlce: 



^mblnatlon of the following categories 
sre the groups teachers fall In 
lubsequent to training: 

K teacher knowledge 

2. teacher attitudes 

3, application of teaching tech. 

there are 8 distinct subgroups, 
showing that when uniform content is 
:resented> It Is assimilated and 
implemented at different levels by 
llfferent teachers. 
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CATEGORY; Knowledge and Training 



page 4 



Reference 



Context Variables 

j^^^A^ eoc Achieve, 
trade pES fj^^^^^ 



Udrrison, 1976 



DIorlo, 1982 



362 



ERIC 



primary 



reading 



Teacher Behaviors 



Effectiveness of teacher related gain of at least 
positively Vi : one year 

teachers' autonomous attitude 
** preference'for'pragmatlc 
activities 
they tend toward abstract conceptual 

dev ^lopment 
they hdve on the avu.-age 3 children 

of their own 
they lecture 1/4 less than other 
teachers whose gain was less 
than a year. 
Teacher's concepjtual lovel was not 
found to be primary contribution of 
student achleve^nent. 



Curriculum theory 

^'knowledge and autononiy are Inversely 
proportional with respect to practic 
(e*g*» carpenters are very closely 
governed by their relevant 
knowledge; citizenship Is an examp 
of the other extreme. 



Outcome/Besults 

Affect 
School Self 



Achievement 
ST LT 



Other 



Amount of knowledpe 
does not provide 
clear guldence to 
practice In teaching- 



no clear body of 
knowledi?'^ Is foun 



Relationship 
with other 
research 



3R3 



4 



r 
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CATEGORY; Affective Factors 



page 1 



Reference 



• irade 



Brophy & Evertsor 
1974 



Brophy, 1979 




Context Variables 



ES 



\chieve. 
Levrl 



>ubj. 



Teacher Behaviors 



Teacher praise of good acaderaic work 
by the student 

during teacher- initiated 

interactions 
•during student- initiated 
interactions 



Praise- 

The direction and intensity of 
the relation of praise to studerjt 
learning vary with context 

Praise may be better characterised 
as an outcome of other classroor 
events that cause student leavening 
than as a cause of such learninc 



Out;come/Results 



Achievement 
ST LT 



positive 

corrcllation 
negative 

correlation 



Affect 
lichool Self 



Other 



Relationship 
with other 
research 
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CATEGORY ; Affective Fartnrs 



page 2 



Reference 



Mrade 



Context Variables 



BES 



\chieve. 
Level 



Subj. 



Teacher Beh&viora 



QutQome/Results 



Achievement 
ST LT 



Affect 
:;chool Self 



Other 



Relationship 
with other 
research 



Anderson & 
Anderson, 1982 



Five principles of affective 
assessment: 

1. know why you're assessing 

2. .know what you're assessing 

3. know what instruments are 
available- (they list 5) 

4. know how good the Instruments ar; 

5. know how to interpret the scores 



Einn8r» Sanford, 
Clements, & 
;Mart1n. 1981 * 



Jr. higl 



English 



Implementation of a program of effect 
classroom managemant techniques 



Evertson, Sandfc 
& Brophy, 1980 



rd jr. 
high 



English 



Some form of individualization or 
ability grouping 



ve 



positive 
correlation 



attitude toward 
teachers- high 
correlation 



CATEGORY l AffprMve F;irfnr^ 



page 3 



Reference 



Context Variables 
qrade pBS 



Evertson. SanforcJ 
& Brophy, 1980 
continued 



Hewberg & loue. 
1982 



ERIC 



3R8 



Jr. 
high 



Vchieve* 
Level 



low 



)Ubj, 



high ablliiy math 



low ability 



math 



math 



math 



reading 



Teacher Behaviors 



Teachers using high percentage of 
subgroups I preferring lecturing, and 
who believ.^d they could do little 
about disciif^!ine problems. 



Teachers who gave frequent homework 



Teachers who held high expectations 
for their classes 



Affective Education Program in 
Philadelphia 

Teachers were trained to: 

conmunicate high expectations of 
1 achievement 
specific & timely w/feedback 
develop sense of shared responsi 

bilities w/students for 

teaching & lessons 



Outcome/Results 



Achievement 
ST LT 



indicatic 
higher ac 

- various 
IRI 
phon 
SSR- 



Affect 
:;chool Self 



n5 oi 
hieven>t'r(t 

tests 

cs 

lime 



comprehension 



Other 



attitude toward 
teachers- 
negative correlat 



attitude toward 
teachers positive 
correlation 



attitude toward 
teachers positive 
correlation 



attitude toward 
teachers negative 
correlation 



Relationizhip 
with other 
rese<<rch 



on 
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CATEGORyi Affective Factors 



page 4 



Reference 



Mrade 



Context Variables 
^chieve• 



BES 



Level 



Teacher Behaviors 



Out;como/Besults 



Achievement 
ST LT 



Affect 
school Self 



Other 



Relationship 
with other 
research 



Beane. 1962 



Combs » 1982 



o 370 
ERJC 



Activities to enhance self-perception 
e.g.: 

teacher-pupil planning cooperativ 

learning 
peor tutoring 
multi-age interactir ^ 
self- evaluation 
out- of- school activities 
conmunity service projects 



impro red 



The importance of affective ed.: 
"Learning w/out affect is unlikely to 
influence behavior and an educational 
system that rules out feeling or 
emation guarantees Ineffectiveness" 

4 Affective Factors which influence 
learning: 

K self-concept 

challenge or threat- best to 
have c. w/out t. 

3. values 

4. belonging and being cared for 



Important to impro 
seif-perceptions 
as an end to itsel 



/e 
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Reference 



<irade BBS 



Context Variables 
Achieve. 



Level 



>ubj. 



Teacher Behaviors 



Outcome/Results 



Achievement 
ST LT 



Affect 
$chool Self 



Other 



Relationship 
with other 
research 



Orookover, Schelt 
Schneider^ 8eady» 
Flood* & 

Ulsenbaker, 1978 



er. 



low 
achievers 



Kernan, 1979 
TESA 



all 



Farley, 1982 
TESA 



all 



3^2 



ERIC 



perceived 
as high 
achievers 



Teacher expectations of student 
performance (Michigan sciiools) 



teacher Interaction 



provide more opportunity to respond 



teachers trained to practice equality 
of Interactions 



gains 



teachers can be trained to hold highe 
expectations of all students & to 
practice equality of expectations, 
Interactions and learning opportunities 

training gave TESA teachers specific, significant 
concrete, observable behaviors that gains 
they cou(d see, practice, and use In 
their classrooms 



differentiated 
effective classes 
from ineffective 
classes 

less motivating 
and supportive tha|i 
^Ith high achiever 



less absenteeism 
K discipline re^erf*a1s 

Dore engaged in 
learning pit^cedure 
than students not 
Perceived as high 
iichlevers 



Improved 
atti 



tJdes 
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Reference 



irade 



Brophy, 1975 



Soar & Soar, 
1978 



Context Variables 



2-3 



iES 



Achieve* 
Level 



high 
low 



high ablllt/ 
low ability 



1&5 



Teacher Behaviors 



positive teacher affect e.g., warmth 
and encouragement 



negative teacher affect (aioong 
generally caring teachers) 



positive teacS.a ar.d pupil affect 



Outcome/Besu I ts 



Achievement 



ST 



negative 
correlation 



positive 
correla 



^,1on 



signl 
correl 



f icant 
atlon 



strongly 
conslste 
negatlv 



and 
itly 



LT i Echool 



Affect 



Self 



Other 



Relationsh 
with other 
research 



Lambeth » 1981 



academ1( 
& 

technic 

high sc( 
student! 



00 1 



Five categories of teacher behavior: 

caring 
respect 

Interpersonal contact 
course organU'atlon 
learning envlronmont 



Best predictor of 
achieves mt: 



teach 

ca 
cou 

teach 
was 
hig 
cor 
w1 



t) 



it carlnp 

plus 
rse org 
2r respe 
also 
ily 

relaced 
caring 



:t 
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page 7 



Reference 



Mrade 6ES 



Context Variables 



Achieve* 
Level 



>ubj. 



Teacher Behaviors 



0ut;come/R68Ult8 



Achievemer<t 
ST LT 



Affect 
$chool Self 



Other 



Relationship 
with othsr 
research 



Horine* l>ershin»er 



2«4 



low 
inuUI 
ethnic 



Brophy, 1981 ^ 
Review of research 



Good & Grouws, 
1979 



elenK 



ERIC 376 



math 



Teacher's pralset as viewed by 
students: 

1. as deserved for a correct or 
■good Idea 

2. as an Instructional function 

3. as a routine Interactive fi ^1o 
such as response to gain class 
attn.i to encourage a students' 
or the class as a whole 

4. as no codeable function 



Praise 

should be spontaneous* sincere, 

specific, & Informative 

(In study after study measures of 
teacher praise filled to correlate 
with other classroom variables, 
that would be e^tpected If It were 
relnforcina,) 



Effective Teacher: 

offers little praise or crlticisni 
basically non-evaluativo 



high participatior 
viewed praise as 
II 

Low participation 
viewed praise as 
12 and saw that 
teacher praise 
helped Identify 
correct answers fo 
them (audience) 



Students res pons e 



some who were 
previously perfonrjing 
for intrinsic valu^ 
of learning may p^fform 
for praise and be 
less motivated 

Some are embarrassed 
by praise, others 
view praise as ^nspncere 
and view it as an 
attempt at encouragement 
because ^.hey are 1 
fact not doing wel 
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Reference 

* 


Conte 


Kt Va 
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rlables 

achieve. 
Level 


lubj. 


Teacher Behaviors 


Ou 

Achiev 
ST 


eroent 
LT t 


Aff< 
;chool 


ect 
Self 


Other 


Relationship 
with other 
research 


Enkins, ig33 
Review of researc 

Crab tree, 1982 
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Reading 


On praise and criticism 


may have 
negative 
effect 












7-8 


regular ed 
special ed 
tutoring 
(1 or 2) 




Praise and Criticism: 

no significant difference betweeii 
large calss* small class^ reg. ed. 
spec. ed.» tutoring and ratios of 
praise and criticism 

most teachers used more praise than 
criticism 

not systmeatic but In reaction to 

student behavior 

oralse eoual for bovs and alrls 

more criticism toward boys 

more criticism than Upraise to group: 








• 
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Hef erence 



< trade 6SS 



Context Variables 



Achieve. 
Level 



>ub.i . 



Teacher Behaviors 



Out;come/Results 



Achievement 
ST LT 



2;chool 



Affect 



Self 



Other. 



with oi.hci* 
rt^searcli 



Beane, Lipka, & 
Ludwig, 1980 

Review of researc 



Greshdnu F., 1982 
Review of Lit. 
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Teachers can build self-esteem In way: 
ather than praise: 

students need feeling of acadenic 
success 

challenging atmosphere In which 
students are successful and do not 
feel threatened 

climate: respect» fairness^ self- 
discipline* & democratic process 

use of techniques which minimize 
failure & maximize success, e.g. 

tc^ learning 

self-evaluation 



acuity Assumptions: 
Re- Was handicapped 

students placed In regular classes 
wll^ have Increased social Interac 
and acceptance with/by regular 
students and that handicapped 
students will reflect the social 
skills of an earlier student 



Ion 



HattGl capped kids 
not trained w/soc 
skills generally 
are not liked, a':* 
& chosen as friends 
by non-hand1cappe( 
students. They 1r 
at low levels and 
not Imitate behav 
of nonhandl capped 
unless specific 
progrartinlng has 
been provided. 



epted 



teract 
do 
or 



381 



CATEGORYi 



page 1 



Reference 
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Kt Va 


riables 

Vchiove. 
Level 




Teacher Behaviors 


Ou 

Achiev 
ST 


ement 
LT ! 


leoulta 

Aff 

ichool 


ect 
Self 


Other 


Relationship 
with oi-her 
research 


Hunter, 1979 

* 
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Teachers* desclslons and behaviors 
must be the outcomes of diagnostic 
Information 

3 Forms of diagnosis: 
formal 
Infomal 

Inferential (based on experience 

3 Areas of diagnosis: 

difficulty of content 
learning style- recommends 
helping children learn 
thru all modalities 
use of principles of learning 

4 Categories of teaching decisions 
and actions: 

those- that Increase the probab- 
ility of students* Intent 
to y /n {motivation) 

the ^ that Increase the rate 
and the amount of learning 

those that enhance retention 

those that encourage the 
transfer of learning to 
new situations th^t require 
problem-solving^ decision- 
making, and creativity. 


) 






» 
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Reference 



( irade 



Peterson, L.T. , 
& HcBrayer, J., 
1976 



Cheek & Cheek 
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Context Variables 



BBS 



achieve* 
Level 



>ubj. 



Reading 



Teacher Behaviors 



Purpose of diagnostic prescriptive 
teaching Is to change emphasis fnm 

?roup-centered teaching to 
ndivlduallzatlon 

Recooinends teaii teaching: 
Diagnostic Teacher 
Teacher Intern (1»e* assistant 

teacher) 
to help teacher meet Individual 
needs of students. 



Reading program should Include 
the following components: 

K scope and sequence grade skills 

2. procedures to facilitate 
continuous diagnosis of each 
student 

3. a variety of materials and 
teaching techniques for 
prescriptive instruction 

4* the use of guided or directed 
reading lesson procedures 

5. methods for keeping records on 
each student 



Outcome/Results 



Achievement 
ST LT 



Affect 
school Self 



Other 



Relationship 
with other 
research 
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Reference 



Mrade 6ES 



Brophy & Everts 
1974 



Oil 



Context Variables 



I. 2nd- 
3rd 



Vchiev-f^« 
Lave I 



high 



low 



lUbj. 



Brophy, 1983 



Evertson, Sanfor 
Brophy, 1980 



i, Jr. 

high 
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(nath 



Teacher Behaviors 



Assigning work that was too easy or 
too difficult 



Assigning no^ inappropriate (level) 
activities 



easy assignments 



too difficult assignments 



Outcome/Results 



Achievement 
ST LT 



negative ( 



orrelatl3n 



positive (orrelati 



l ow learni ng gains 



low learni n g gains 



Affect 
School Self 



3n 



I mportance of high success ra te : 



Teacher present to monitor and 
give feedback (material which is 
new and provides a challenge 
should have teacher present) 

Students working Independently 
applying skills al realty mastered 
_or^ p racticing to ens ure retentio r 



Observed to be most effective: 

frequent use of self-made and 
standardized assessment 
instruments for diagnosis and 
evaluation 



Other 



Recommends ; 

70-80X 
success 



95-100): 



Relationsh 
with other 
research 



3«7 



I 



CATEGORYt Diagnostic- Prescriptive F^ct^OfS 



page 4 



Reference 



Mrade 



Context Variables 



BES 



Achieve » 
Level 



Teacher Behaviors 



Outcome/Results 



Achievement 
ST * LT 



Affect 
lichool Self 



Other 



Relationship 
with other 
research 



Fltzroaurlce* 
1976 



4-6 



Spel ling- 



Read Ing- 



Fesler, 

Guldubaldl, & 
Kehle, 1976 * 



K-3 



urban » 
iiostly 
black, 
soQie 

lelghbbrhood 



Inservlce training In diagnostic- 
prescriptive approach 



higher th 
control 



n In 



group 
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may be hie 
In control 



her thar 
group 



PEP-IPI 

Primary Education Project- 
Individually Prescribed Instruction 

emphasis on maturatlonal 
processes and learning beyond 
these processes (Piaget; Gagne) 

PEP Focuses on: 

perceptual & motor abilities 
language concepts 
classifying skills 
reasoning abilities 

IPI focuses on definite skills in: 

reading 
math 

Teacher & Parent Involvement 



higher 
control 



thin 
group 



This type of 
research Is criticized 
because of lack of 
control over control 
group varlables- 
1n this case exp. 
teachers were trained 
while control teuchers 
weren't. 



reduced transfer 
requests from 
teachers 

teachers for proje 

parent approval an{l 
change 

-Increased 
attendance at 
school-comm. 
functions 

-successful^ 
organization 
of Follow 
through paren 
groups 
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Reference 



< irade 



Context Variablea 
Vchieve. 



Level 



)Ubj. 



Teacher Behaviors 



Outicome/Resu 1 ta 



Achievement 
ST l/t 



School 



Affect 



Self 



Other 



Relationship 
with ottter 
research 



Saunders- Harris 
& Yearly, 1981 



inixed 



science 



Diagnostic- Prescriptive Teaching 



not sign- 
ficant 



signifi- 
cant 
positive 



positive 
toward 
use of 
objectives, 
diagnosis 
& remedation 



Also, on locus of 
control : 

inte'^nal studen 
scored higher 
than external 
students. 



Arter & Jenkins, 
1979 



Review of research & challenge to 
belief that differential diagnosis 
prescriptive teaching is valid and 
Justifiable. 

article describes DD-PT as- 
diag. info, is used to generate 
a program to directly remediate 
an underlying ability weakness. 
To the child activities In the 
areas of weakness are prescribed 



They say 
children do 
not appeal 
to benefii 



Ewing & Breht, 1977 
Research has not 
validated diagnostic 
prescriptive models. 

Programs using D-P 
models should be 
viewed cautiously 
& carefully 
inonitored 



DO-PT predominant model In spec. Ed. 
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Reference 



irade 



Context Variables 



iES 



Achieve. 
Level 



Teacher Behaviors 



Oui;come/R6sulta 



Achievement 



ST 



LT School Self 



Affect 



Other 



Relationshio 
with other 
research 



Heckler & Youngbe 
1975 



IMPACT- diag. -prescriptive teaching 
kit for regular teachers with 
mainstreacned LD and ED students 

Includes materials for: 

assessing academic skills* beh, 
needs » & learning processe: 

suggestions for prescriptions 
based on assessment 



Improved self- 
concept & 
attitudes toward 
learning 



Whyte. 1980 ^ 



6-^4 yrs 
9ld 



rural 
Canad 



learning 

behaviora 

disorders 



Use of the prescriptive or diagnosti 
teaching model: 

more research is needed 
use of the model is usually 
overly simplistic & of 
doubtful nature 



Greater cains in 
intellect ual 
development than 
control (roup 



Individual Profiles- relatively 
higher gains by: 



Greater 
reading 
language 
& social 
ment thar 
group 



ains in 
math» 
skills^ 
develop 
control 



EKR and *'slovJ 
visual-motor 
better 
with 
all the hyper 
childrer 
level of 
made lea 



learners" 
responded 
tjhan those 
tory problems 
active 
descreased 
activity & 
rning gains 



auci 



Numerous childrer 
return to regular 



were able to 
classes 
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i 



Apperidix M 



Training Options 
Coding Manual 
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Training Options Coding Manual 



The SNAP training options data base contd^ns numerous 
types of learning experiences for classroom teachers of 
malnstreamed special education students. Included In the 
data base are: workshops; modules; chapters In special 
education textbooks; personal accounts of handicapped people 
In books and films and In teachers' meetings with 
h&ndlcaoped individuals or their families; procedures for 
classroom observation with and without peer participation; 
specific teaching strategies; procedures for collaboration 
with other educators; recommendations for action research. 

Each training option is described irt the data base in 
such a way that the SNAP expert system can select 
individually appropriate training for each teacher usinfr the 
system. The following is a list of the fields used for 
describing each training option: 

Name 

Short Name 
Stage of Concern 
Goals 

Goal Specificity, Goal "d" 
Goal Specificity, Goal "1" 
Academic Learning Time Problems 
Questioning Problems 
Direct Instruction Problems 
Affective Mode 
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Teaching Level 
Teaching Area 
Situational Requirement 
P rerequi s1 te 
S nape 

Description 
Content 

^25JlIll-2l •EiSl^ 1 • explanation of each of these fields, 
plus codes used to describe training options, follows: 

Name - title or name of training option. 

Short Name - shortened version of title or name of 
training option. 

Stage of Cc.icern - level or levels of personal concern 
regarding mal ns treami ng, as determined by SNAP 
adaptation of Gene Hall's Stages of Concern Instrument. 
The six subscales used In the SNAP adaptation and 
addressed to the respondent are: 

Informational - You have a general knowledge of 
mal nstreami ng, but you are Interested In learning 
more about It, particularly about general 
characteristics, effects, and requirements. 

Personal - You are uncertain about the demands of 
mal nstreami ng, the effect It may have on your role 
In relation to the reward system, decision-making. 
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and potential conflicts with your own personal 
comml tments. 



Management - You are concerned with the procedures 
and tasks Involved with mal ns treaml ng, and with 
issues related to efficiency, organization, 
scheduling, and demands on your time. 

Consequences - You are concerned with the Impact 
of mal nstreaml ng on all the students you deal with 
dally, both those who are handicapped^ and those 
who are not. 

Collaboration - Your focus Is on coordinating and 
cooperating with other teachers and staff members 
to optimize the effects of mal nstreaml ng. 

Refocusing - Your focus In on exploring ways to 
Improve mal nstreaml ng. Including the possibility 
of changing the way It Is accomplished. In order 
to maximize Its benefits to all students. 

A training option is coded for one or more stages for 

which It would be appropriate as training. The field 
Is called SOC. 

Codes are: In - informational 

pr - personal 

mn - management 

cq - consequences 

cl - collaboration 

rf • refocusing 
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Goals - Training options are coded for goals so that 
they correspond to the learning goals that teachers 
have selected. A training option may be coded for one 
or more goals, or it may be given a code of "none" if 
the purpose of the training Is not clearly associated 
with one or more learning goals. 
Codes are: 

I would like to learn more about. • . 

a - special education procedures In my school. 

b - special education services that are available In 
general . 

c - approaches to working with special education 
s tuden ts. 

d - the types and characteristics of students served In 
special education. 

e - the learning problems that students can have In 
school . 

f - how to obtain Instructional help In my classroom 
from special educators. 

g - how to use classroom aides. 

h - how to gain access to Instructional materials, 
equipment, etc. for malnstreamed students. 

1 - how to obtain additional Information about 
malnstreamed students In my class. 

j - how to work with other educators on tasks related 
to malnstreamlng. 

k - how to select and adapt materials to teach students 
who have trouble learning. 

1 - how to teach students who are having trouble 
1 earning. 

m - how to encourage desirable socla^. Interactions 

between special education and non-special education 
s tuden ts. 
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n - how to provide Instruction for slower students 

without disrupting Instruction for other students. 

0 - how to analyze student learning problems to 
determine how to deal with them. 

p - how to deal with the issue of grading students 
fairly when they vary widely in ability. 

q - how to keep better track of how students are doing 
In my class. 

r - how to determine students' skill level In relation 
to what I teach. 

s - (This goal has been deleted.) 

t - how to Interpret assessment results in a student's 
records. 

u - the behavioral and motivational problems that 
students can have In school. 

V - how to Identify students with behavioral or 
moti vati onal p rob 1 ems . 

w - how to deal with students' behavioral or 
moti vati ona 1 problems . 

X - how to confer with parents. 

none 

Goal Specificity, Goal "d" - Goal "d" states: "I would 
like to learn more about the types and characterl stcs 
of students served In special education." Training 
options are coded to Indicate specific handicapping 
conditions to which the content pertains. The field Is 
called DSPEC. 

Codes are: Id - learning disability 
mr - mental retardation 
ed - emotional disability 
V - vision 
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h - hearing 
spl - speech and language 
o1 - orthopedic handicap 
c1 " chronically 111 
cf - cystic fibrosis 
cp - cerebral palsey 
ep - epilepsy 
md - muscular dystrophy 
sb - spina bifida 
none - used when the training option Is not 

specifically for a certain handlcap(s) 

Goal Specificity, Goal "1" - Goal "1" states: "I would 
to learn more about how to teach students who are 
having trouble learning." Training options are coded 
to reflect major categories covered by this goal. The 
field Is called LSPEC. 

Codes are: Isr - teaching strategy, reading 
Ism - teaching strategy, math 
Iss - teaching strategy^ science 
Iso - teaching strategy, social studies 
Isl - teaching strategy, language arts 
Isa - teaching strategy, art 
Isp - teaching strategy, p.e. 
Ish - teaching strategy, home ec. 
Isl - teaching strategy. Industrial arts, 
voc-ed 

Isg - teaching strategy, general 
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Icm ^ classroom manageinent techniques or 
principles 

lal - activities for teachers to provide 
additional insight into teaching 
students who are having trouble 
1 earni ng 

1ms - information or assistance regarding 
mai nstreami ng in general 

Academic Learning Time Problems - Training options are 
coded to mark training that is appropriate for 
assisting teachers in improving their Academic Learning 
Time (ALT)* Specific codes mark training that should 
enhance total engaged time of students, students* 
success level, and allocated time. The field is called 
ALTPROB. 

Codes are: et - Engaged Time 
si - Success Level 
a t - Al located Time 
info - used when the need is for the Academic 
Learning Time information packet 

none 

Questioning Problems - To Indicate training which Is 
useful for teachers whose questioning style or strategy 
Is weak, training options are coded for the variables 
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related to effective questioning. The field Is called 
QUESPROB. 

Codes are: or - Opportunity to Respond 
si - Success Level 
rd - Response Distribution 
Info - used when the need Is for the 

Questioning Skill Information packet 

none 

Direct Instruction Problems - Training Options are 
coded to show their usefulness for Improving teachers' 
direct Instruction. The field Is called DIRPROB. 
Codes are: high - for someone whose DIR Is too high 
low - for someone whose DIR is too low 
Info - used when the need Is for the 
Direct Instruction Information 
packet 

none 



Affect Mode - Training options which have a 
predominantly affective purpose and which are 
recommended for teachers who will receive attitude 
adjustment training are coded as either active or 
passive. "Passive" Indicates training which Is 
experienced primarily through viewing or reading. 
"Active" Indicates training which requires the teacher 
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to become actively Involved (e.g., a meeting with a 
colleague who has a positive attitude toward 
mal nstreaming ) . Training which does not have 
predominantly an affective function Is coded "none." 
The field Is called AFFCTMODE. 
Codes are: p - passive 

a - active 

n - none 

Teaching Level - Training options are coded to reflect 
the level or levels for which they are appropriate. 
The field Is called TLEV. 
Codes are: el - elementary 

jh - junior high/middle 
sh - senior high 
all 

Teaching Area - Training options are coded to Indicate 
the teaching area, or subject, of a teacher for which 
they are appropriate. The field Is called TAREA. 
Codes are: la - language arts (Including English, 

read'^ng, and spelling) 
ma - mathematics 
ss - social studies 
scl - science 
h - health 

pe - physical education 
mu - music 
art 
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hec - home economics 

la - Industrial arts 

ve - vocational education 

fl - foreign language 
all 

Situational Requirements - Training options which will 
be appropriate only if certain conditions are met are 
coded for specific situational requirements. The code 
system must expand with the growth of the training 
option dtta base. The field is called SITREQ. 
For current training options, the codes are: 

( s=school ) 

sap - administrative participation 

stm - time in August or September for meeting 

scb - self-contained special education classes in 

your building 
sse - opportunity to observe special education 

teacher 

scp - 10-15 teachers with common problem 
Shi - several teachers of hearing impaired 

s tuden ts 
spg - teaches primary grades 
sig - teaches intermediate grades 

{c=chi1d) 

eld - teacher has Id students 
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cvl - teacher has vision Impaired students 
Chi - teacher has hearing Impaired students 
csl - teacher has speech and language Impaired 
s tudents 

(e=equipment) 

evo - video equipment and operator 
ecp - computer available :u school 

{h=huii:an resource) 

hse - collaboration with special education teacher 
In the tutoring of a special needs student 

hcc - colleague In classroom or videotaping 

has - aide or special education teacher 

hfa - colleague who has favorable attitude 

toward mal ns treami ng and teaches class(es) 
which Is (are) similar to trainee's 

het - Identification and videotaping of expert 
mal ns treami ng teacher 

hhc - access to a handicapped child 

hhp - recommendation by special education teacher 
of parents who will meet with teachers 

Prerequisite - Since some training options will be 
effective only If a teacher has had certa^'n background 
experiences, training options are coded for personal 
prerequisites when necessary. The code system must 
expand with the growth of the training option data 
base. The field is called PREREQ. 
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For current training options, the codes are: 

{r=research experience) 

rcr - experience in conducting research 

rrr - experience In reading research reports 

red - experience In curriculum development 

rwp - experience with word processing 

Shape - An abbreviated explanation of the physical form 
of the training option is given, e.g., film, videotape, 
classroom observation, book, chapter(s) in a book, 
article in professional journal, conversation with a 
colleague. The code system must expand with the growth 
of the data base. The field Is called SHAPE. 
For current training options, the codes are: 

acti vi ty 
article 

artlcle&bklet (article & booklet) 
artc&lesson (arjlcle & lesson) 
bk&hdout (book & handout) 
book 

booklt (booklet) 
book&module 
brochu (brochure) 

brochu-wkshp (brochure and workshop) 
catalg (catalog) 
chaptr (chapter) 
chapt & module 
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chaptr&appen (chapter & appendix) 

chapt part (chapter part) 

chat 

chklst (checklist) 

c1 obs (class observation) 

cl obs w/frm (class observation with form) 

confer (conference) 

conversation 

film 

film/disc qu (film & discussion questions) 
fllmst (fllmstrip) 
f ol ders 
handout 

hndout&artcl (handout & article) 
handbook 

kit & hdout (kit & handout) 
manual 

meetng (meeting) 
module 

module&artcl (module & article) 
monogr (monograph) 

obs & report (observation & written report) 

organiz ( organi za ton ) 

outl 1 ne 

pamphlet 

research 

si 1 des 
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software 
visit 

vtape (videotape) 
• wk shop (workshop ) 

Description - Thorough description of the training 
option Is provided with information necessary for 
locating It for training purposes. The Description 
includes the training option copyright date, If a date 
Is available and a reasonable part of the description. 
The field Is called DESCRIPT. In DBaselll descriptions 
are stored as a memo field. 

Content - The contents of training options are 
summarized In a DBaselll memo field called CONTENT. 

Q.£IiilILiZ-Ei£ij2Il • facilitate appropriate selection of 
training, several of the fields discussed above are coded 
with certainty factors. (The fields that are coded with 
certainty factors are: Stages of Concern, Goals, Affect 
Mode, Affect Mode — Passive, Affect Mode — Active, Teaching 
Level, and Teaching Area.) The codes are: 

A - Always 

H - High 

M - Moderate 

N - Never 

These codes influence the likelihood that a training option 
will be selected for a particular characteristic of a 
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teacher being trained. For example, a Teaching Level of "el" 
means the training Is for an elementary teacher. To key the 
training as highly appropriate for an elementary teacher but 
moderately appropriate for a junior high or middle school 
teacher and of low or no appropriateness for a senior high 
teacher, the traning for TLEY would be: TLEY^elH jhHshN . 

The code of <A>, as a certainty factor, means that the 
training should ALWAYS be associated with a particular 
characteristic, e.g., TLEY=elA means that onl^^ an elementary 
teacher should receive the training. The code of <N>, as a 
certainty factor, means that the training should NEVER be 
associated with a particular characteristic, e.g., TLEV=shN 
means that the training should never be recommended to a 
senior high school teacher. The certainty factor <H> Is an 
Indication of high confidence In a code by the coder. The 
certainty factor <M> may be an Indication of moderate 
confidence In a code by the coder. 

C £d 1^£2_C 0 n v e n t J[ on . To facilitate readability of the coding 
system, the following rule Is followed: All codes are In 
lower case, with the exception of certainty factors, which 
are only In upper case letters. Memo fields (Descriptions 
and Contents) are passages of text written In standard 
English. Fields must be coded with letters or letter 
combinations, not with numbers. 
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Appendix N 



Technical Report #204 

Expert Systems for Educational 
Decision Making 
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Abstract 



This paper reviews artificial intelligence expert systems that 
have been developed for educational decision making. These include 
systems for planning, decision support, training, and research. The 
expert systems included in this review meet three criteria that 
distinguish expert systems from other computer programs: the system 
produces recommendations comparable to human experts in that domain; 
the system has separable components for representing knowledge and for 
reasoning; and the reasoning process is traceable to the user. For 
each use of expert systems, examples of existing sytems are described, 
and potential benefits and problems are discussed. Finally, cautions 
to would-be expert sytem builders are presented. 
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Expert Systems for Educational Decision Making 
Jacqueline A. Haynes 
Virginia H, Pilato 
David B, Malouf 

Institute for the Study of Exceptional Children and Youth 
Department of Sp'scial Education 
University of Maryland 

For education, expert system technology is finally "coming 
of age. Until the last few years, expert systems required 
computing hardware and' computer science expertise that were both 
expensive and difficult for educators to obtain. Recently, 
however, microcomputer-based, affordable authoring tools for 
expert systems have become available, enabling subject matter 
experts, such as educators, to develop expert systems for use in 
their own domai-n. These advancements have encouraged the 
development of educational expert systems that have great 
potential benefit for a variety of educational applications. In 
this paper, several recently developed educational expert systems 
wi.ll be described. They exemplify only a few of the potential 
uses for this technological advance. 

This discussion is limited to systems that meet three- 
important criteria for expert systems:- 

o the system* s re commend at i ons are comparable to those offered by 
a human expert in that domain; 

o the systems have separable components for representing 
knowledge and for reasoning with that knowledge; and 

o the reasoning process is traceable; i.e., the system has 




the ability to explain its reasoning process to a user (Waterman, 
1986) . 



Systems that do not meet these criteria are not being considered, 
since lack of these features would seriously limit their uses. 

Four basic categories of expert system use will be described 
in this paper: 

1. planning 

2. decision support 
3* training 

4. research. 

Each use will be explained and instantiated with an exisiting 
educational expert system. 



An expert sytem has great potential as a tool for 
educational planning. Given information about the current status 
of a student, or a program and a desired goal, an expert system 
could infer intermediate steps that should be achieved 
sequentially, and the amount of time or money required to reach 
the goal, or it could define strategies for achieving the goal. 
For example, a knowledge base consisting of production rules 
concerning desirable ratios of teachers to students under various 
condi tions ( grade, subject, physical si2e of a classroom, years 
of teacher experience, contractual obligations, etc.) and current 
information such as enrollment figures, number and experience of 
teachers currently on staff, etc., could be used to plan 
staffing of school buildings within large school systems, as well 
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as to plan for hiring or staff reductions. 

CAPER ( Computer-Assisted Planning for Educational Resources) is 
an expert system that is intended to serve a planning function. 
It is being developed at the Institute for the Study of 
Exceptional Children and Youth at the University of Maryland 
CAPER is an attempt to address the problem of over-referral for 
special education services in schools that have a large number of 
studonts identified as -at risk** by their teachers. The goal is 
to develop an expert system that will help in planning sound 
instructional programs for indivdual students during the 
referral, diagnosis, and instructional planning processes. The 
system will recommend the best instructional program for a 
student prior to his/her placement in special education. Using 
information about effective classroom interventions for students 
who are experiencing specific problems, the expert system will 
recommend feasible instructional options within the regular class 
setting. In addition, it will guide formal diagnostic procedures 
and consideration of special placements. Currently naturalistic 
research is being conducted to determine what processes would 
help to alleviate problems of over-referral and inappropriate 
recommendations for special education placement, and what 
classroom interventions would be most useful to include in the 
system. 

Two other educational expert systems which would be useful 
for planning were deve?.oped by the Artifical Intelligence 
Research and Development Unit, Developmental Center for 
Handicapped Persons, Utah State University. "Mandate Consultant" 
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(Parry, 1985) reviews the lEP (Individualized Educational 
Program) development procedures. As a planning tool, it can be 
used to help plan lEP development, ensuring that all legal 
requirements are met so that hearings to resolve parent-school 
system disputes are needed less frequently, "Behavior 
Consultant- ( Ferrara, Serna, and Baer, 1986) is an expert system 
designed to recommend interventions for behavior-disordered 
students. Like CAPER, it can be used to plan individual student 
programs, 

A restriction on using expert systems for educational 
planning (and for other domains as well) is that good results 
will strongly depend on good data. For example, if a teacher who 
is using -Behavior Consultant" does not accurately describe the 
student's behavior, or if the collected data is incorrect, the 
interventions recommended by the system "will probably be 
ineffective. Part of the expert knowledge of a human behavior 
consultant is in recognizing and questioning data that looks 
faulty. While it may be theoretically possible to emulate within 
an expert system the human ability to question data, that 
capability is not currently part of the system (or other similar 
systems). Likewise, it will be impossible for the CAPER system 
to help plan instructional interventions that will be effective 
if the data describing a student's current status is incomplete 
or inaccurate. 

B§£Lslon SuEE2Lt 
A second use for expert systems in education — and the most 



common one in general - is for decision support, or as a "second 
opinion" for decision making. Many medical expert systems, such 
as MYCIN (Davis, Buchanan and Shortliffe, I975) have been 
developed for this purpose. Examples of educational expert 
systems that are designed for use in decision support are CAPER, 
CLASS. LD, and "Mandate Consultant", though some serve other 
purposes as well. One use of the CAPER expert system will be to 
offer recommendations for diagnostic procedures leading to 
appropriate instructional placements for students. Because of 
the expert knowledge embodied in the system, these 
recommendations will include only those tests and procedures that 
are valid for a student' s age, language/cultural background, etc. 
These recommenda-ti ons might add a new point of view to the 
deliberations of the instructional planning team, or may simply 
reinforce (or refute) their opinion. CAPER will also be helpful 
in a decision-support role for interpreting test data, since it 
is designed to yield technically valid interpretations of the 
test scores. In this capacity, CAPER would help to provide 
decision support that is not biased by race or ethnicity, is not 
forgetful of technical limitation: of tests, and is not inaccurate 
in reporting data, as humans can sometimes be. 

While CAPER is still in the development stage, so that its 
benefits can only be hypothesized, "Mandate Consultant" and 
CLASS. LD are completed systems that have been validated. Mandate 
Consultant can provide a reliable second opinion >( Parry, 1986) in 
determining whether correct procedures have been followed in the 
development of a student's lEP. This information can be helpful 
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to those in state and local agencies who are reviewing case 
histories, to officials preparing for hearings, or to parents who 
may question the correctness of educational procedures followed 
with their child's case. Likewise, CLASS. LD can provide a 
reliable second opinion regarding the appropriateness of a 
learning disabilities classification for a given student. Both 
of these expert systems have been subjected to extensive 
validation measures comparing their performance to that of human 
experts. Both systems have performed as well as the best of the 
experts, and better than many of them (Parry, 1986). 

Est&ntl&I Ec&kleQg 

Using expert systems as a "second opinion" is certainly less 
problematic than using them as a primary decision tool, but use 
in the second opinion capacity is still not without its problems. 
One problem is that it is not at all clear whose "expert" 
knowledge should be built. into such a system; i.e., there is no 
consensus on who the experts are. 

Eh2 §ji£ fehS ExSSCtSi In education, expertise is divided 
among several sources including researchers, public officials, 
administrators and supervisors, and classroom teachers. While 
each of these sources of expertise can be important, they often 
present differing points of view on an issue. The result of 
considering all points could easily be unintelligible when the 
viewpoints do not come together neatly, or when they yield 
conflicting recommendations. In deciding whose expertise to 
build into an expert system, one should consider whose point of 
view would be most useful for the system' s application. 

For example, CLASS. LD ( Hof meister, 1984) uses 
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knowledge derived from state and federal regulation to reach its 
decisions and recommendations. Similarly, -Mandate Consultant- 
(Parry, 1985) uses legal, regulatory information to review 
procedures for the development of lEPs. m these cares, clearly 
the best source of erpertise to build into the knowledge base is 
the regulation itself, since that information is, by definition, 
the most aut hori tative source* 

The answer to the question of whose expertise to include in 
the CAPER knowledge base, however, is much less clear. Hho can 
provide the best expertise on the appropriate instructional 
program for a given student — researchers, university 
consultants, school principals, school district specialists, or 
talented classroom teachers? While many disciplines have 
acknowledged authoritative sources for their expertise, the only 
consensus among educators is that practitioners, researchers, and 
policy makers know different things and need to share their 
expertise more. For this reason, the CAPER knowledge base is 
being designed to include information from specific sources for 
specific topics. Rather than combining sources of expertise for 
a single topic, the approach being used is to select one source 
of knowledge for eac^ topic that can best be used in the 
decision-making process. Figure 1 indicates the source of 
information for the specified topics included in CAPER. 

insert Figure 1 about here 

HOH mU5,h can ysa tcust felia eSESCtal Another potential 
problem with using expert systems for decision support is 
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deciding how much the recommendations of such a system can be 
trusted; i.e., how sure can the user be that the system's 
"reasoning" is correct? Two features of expert systems help with 
this dilemma. First, until its accuracy is tested, validated, 
scrutinized, and subjected to extensive evaluation, any system 
should be used only as a £§L£2ni fiEi.ni.2n, and not as a primary 
decision-maker. Until both the technology for building expert 
systems and the specific system are more fully tested, expert 
systems should supplement, not replace, human decisions. 

The second featu^^e of expert systems addressing the issue of 
accurate reasoning is the requirement that an expert system's 
reasoning process be ••traceable," allowing users to compare the 
inferences that the system makes with their own inferences. In 
this way, during a consultation, the intermediate results can 
always be checked. If there is error due to faulty data, the 
user can correct it. If faulty reasoning is detected, the 
knowledge-base author can make changes. The human user will 
always bear the the ultimate responsibility for intelligent 
decision making, for using the specific feature of the expert 
system efficiently, and for cautious use of expert systems in 
field applications. 



ExE£Lt §s:at£3& £21: itainLns 

A third educational use for expert systems is in training. 
Expert systems have potential as training tools in at least three 
ways^ First, an expert system can recommend training for 
teachers. Second, they can teach information and processes to 
teacher trainees. Third, they can serve a training function 
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simply by beins used by novices who learn from the process of 

interacting with the expert knowledge embodied in the system. 

An example of each of these training roles will now be discussed. 

R££2CDDl£ll4jLaS fecajLainSw snap (Smart Needs Assessment 
Program) is a large, complex expert system that recommends 
training experiences for regular education teachers who teach 
mainstreamed handicapped students. The goal in designing SNAP 
was to produce a system that would create individualized training 
programs for teachers that would take into account the amount of 
prior training they have had, their attitudes toward 
mainstreaming and teaching handicapped students, their own goals 
for professional training, their knowledge about effective 
teaching methods and procedures, and their overall skill in 
implementing instruction in the classroom. Each of these areas 
and the source of information for them are listed in 
Figure 2. SNAP uses information from each area to determine, for 
an individual teacher, a set of training needs. These needs are, 
in turn, uced to select appropriate training options from an 
extensive database of modular training components. The 
components address a' single training need or a group of needs. 
The selection of training options is also influenced by other 
factors such as cost, location, situational requirements (such as 
whether videotape equipment is required or whether access to the 
handicapped population is required for an observation), and other 
factors that would affect the appropriateness of a training 
option for a particular teacher's training needs. 

The educational value of SNAP is its ability to train 
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teachers in what they needs to know. The usual approach to 
training teachers for mai nstreami ng has been a -shotgun" approach 

a general course < perhaps •'Introduction to Special Education" 
or -Introduction to Mains treaming-) covering numerous topics and 
providing very general information to a group of teachers 
Presumed to be homogeneous in their training needs. Like 
homogeneous classroom instruction for youngsters, this approach 
is clearly lacking in its ability to meet individual needs. 
SNAP, then, has the potential of addressing this need by 
providing an individualized approach to training teachers for 
mainstreaming and — if it is found effective — to providing 
inservice training in other areas. The individual components of 
SNAP have already undergone field testing as they were being 
developed. The total system is currently undergoing extensive 
validation and evaluation, and the preliminary results look quite 
encouraging. 

laashiDS inCfiCEDatlsn and ECScaaaaa. Expert systems can also 
be designed specifically for teaching a specified 5roup of 
individuals a body of information, skills, and/or processes. 
Expert systems which serve this pedagogical function have usually 
been preceded by the "second opinion" type of expert system, 
which was then modified for use as a training tool. MYCIN 
(Davis, Buchanan, and Shorlliffe, 1975), for example, is a 
medical system for diagnosing bacterial diseases. from the 
characteristics of bacterial cultures and patient symptoms. 
Subsequently, NEOMYCIN (Clancy and Letsinger, 1981) was developed 
as a modificatuib if the MYCIN system for teaching students to 
diagnose bacterial diseases. Several expert systems developed at 




Utah State University have followed this two-step procedure of 
devalopment from decision-support to training. For exan.-^le, 
using CLASS. LD as the initial expert system. Ferrara and Prater 
(1985) modified the system to teach non-special education 
teachers to claasify correctly students as learning disabled or 
not. Prater and Ferrara (1986) cite two approaches to the 
development of -training- expert systems. One approach is simply 
to teach the rules incorporated into the knowledge base so that 
novices will now have access to the same knowl'?dge as the 
experts. The second is to use sample consultations of examples 
and non-examples to train teachers to make this discrimination in 
a conceptui>'> learning approach. These approaches are being 
developed with -Mandate Consultant" and "Behavior Consultant" as 
well. 

HaXlaa u££ aSEect ECfiSadUnaa. Another way of using 
expert -ystems for training purposes is through the process of 
having novices run consultations with the system. By modelling 
the behavior of experts in seeking information, forming 
hypotheses and providing recommendations, the expert system is 
allows the novice user to deal with that expertise in a way that 
the novice can then emulate. Initial evaluation data from field 
tests of SNAP indicates that teachers believe they have learned . 
considerable amount of information about teacher effectiveness 
just by collecting and reporting the data requested by the 
expert system. flith CAPER, it is also anticipated that by using 
the system's guidance through the referral, diagnosis, and 
planning processes for educationally at-risk students, decision- 
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making team members will become more skilled in the process 
themselves. 



A fourth function for expert systems in education is for 
research. During the development of SNAP, the value of expert 
systems as a research tool emerged as an important contribution of 
the technology. As a research tool, expert system development 
can be used to examine the processes and information used by 
expert educators to solve particular problems. Second, in 
assembling the relevant knowledge and expertise needed to solve an 
educational problem, the system authors can discover instances of 
missing knowledge, inconsistent knowledge, and undocumented 
knowledge can be examined. Examples from the development of SNAP 
will help to explain these potential research benefits from the 
design of expert systems. In developing SNAP, it was first 

necessary to determine what kind of reasoning processes human 
experts in staff development would use to plan individualized 
inservice training programs for teachers. By examining these 
processes, we learned that the most common inference method used 
in expert systems — production rules — was inappropriate for a 
major part of the SNAP system. He determined that production 
rule reasoning (described elsewhere in this issue) would be 
appropriate for determining training needs, but not for selecting 
training options. it then became necessary to "try out" other 
inference mechanisms available in authoring tools. This process 
led to our consideration of abductive reasoning, minimal covering 
and irredundant covering, developed to model diagnostic reasoning 
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in medicine (Reggia et al, 1985), for our problem. Engaging in 
this process of examining the appropriateness of inference 
methods has led to further research on the type of reasoning 
processes that are actually used by educators to make decisions, 
and the influence of that type of reasoning on decision making 
(Haynes and Lubell, 1986a; 1986b), 

The second advantage that expert system technology can 
provide to educational research is to demonstrate to researchers 
and users the limitations of curr^sntly existing knowledge in an 
area of their discipline. For example, an important component of 
SNAP is the production rule knowledge base that is used for 
evaluating observational data to determine an individual 
teacher's skill in the classroom. The large body of research on 
teacher effectiveness which was used to create the knowledge base* 
was analyzed systematically and the results were then formed into 
production rules. By engaging in this process, we found some 
important limitations to this research including: 

o lack of research dealing with students and classrooms 
at certain grade levels; 

o over-generalized conclusions reached from 'significant 
but weak correlations; 

o lack of rigorous outcome measures on many studies 
measuring non-achievement outcomes; 

o over-reliance on highly inferential procedures for 
measuring factors such as students' engaged time; 

o unjustified substitution of Academic Learning Time 
for achievement in studies interpreted as measuring achievement 
as an outcome measure; and 
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o many unresolved contradictions in findings regarding the 
relative merits of direct instruction vs. other instructional 
methods. 

As a research tool, then, expert systems can be extremely 
helpful in guiding researchers to formalize and organize a large 
body of knowledge, and in understanding the reasoning processes 
used by experts to make educational decisons. 

The experiences in building educational expert sytems so far 
have been promising, but a few limits to this enthusiasm are 
in order. 

1. Currently, expert system tools rely heavily on 
production rules and deductive inference. While considerable 
portions of educational expertise may be accurately represented 
in this format, we have found that much of it is not. It would 
therefore be extremely important that knowledge base authors 
recognize the influence of a given reasoning process on the 
outcome of an educational decision, and that either they select 
tools that can model that process or limit their applications to 
those areas that can accurately be represented by existing expert 
system authoring tools. 

2. The expertise built into expert systems should reflect 
the feest source of knowledge on a topic, and not simply the most 
easily obtained source of knowledge. Where multiple sources are 
available, they should all be evaluated and used appropriately. 

3. Where expert systems are used for training, thorough 
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evaluation of the system should take place ELifin tfi adaptation 

for training purposes so that trainees learn expert information and 

procedures, rather than novice-level skills. 

^. Expert system technology in education is new. Its 
potential is great, but its performance record is not yet 
establ.lshed. Until a successful record is 

established, expert systems use should be limited to decision 
support, or second-opinion status. 
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Figure 1 
Sources of Expertise in 

TOPIC 

Effective interventions for 
a given student problem 

Feasibility of interventions 

Availability of instructional 
options 

Student data 

Required procedures for assessment 

Formal tests for obtaining 
specified data 

Valid interpretations for 
formal test data 

Informal diagnostic procedures 

Interpretation of informal 
diagnosis 



CAPER 

SOURCE 
Research literature 

Naturalistic research 

Naturalistic research 
District personnel 

Teacher input 

District policy 

Research literature 
State and local policy 

Technical manual for 
tests 

Informal consultants* 
recommendations 

Informal consultants' 
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Figure 2 



Teacher Characteristic 

Attitude toward mainstreaming 
and teaching handicapped 
students. 

Goals for training 

Classroom effectiveness 
including 

Direct Instruction Ratio 
Questioning skills 
Academic learning time 

"Experience, training, age, etc. 



Information Sources For SNAP 

Computer Program 
SOC 

GOALS 

DIRprob 

Quesprob 

ALTprob 

PERSDATA 



Description 

A modification of the Stages pf 
Concern to deal specifically 
with mainstreaming. 

Teachers select a set of goals 
for their training. 



Teachers collect self-observation 
data and the program evaluates «* 
their ratio of direct instruct ion • 

Teachers analyze their patterns 
of questioning and the program 
evaluates its effectiveness. 

Teachers collect self-observation 
data and the program evaluates 
the amount r,t academic learning 
time available in the classroom. 

A collection of demographic 
information. 
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Appendix 0 

SNAP Course Evaluation: 
Content Analysis of 
Written Comments 
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SNAP COURSE EVALUATION: CONTENT ANALYSIS OF 

WRITTEN COMMENTS 
Shari Cast! e 
August 20, 1986 

Question 1: Was it a successful learning experience? 

Yes =18 No = 0 

Why? 

— tropts: the book, variety, practicality, usefulness, 
direct application, new Ideas (15 = 83%) 
— sharing between participants: <7 = 39/i> 

— presentat i on : excel 1 en t , probl em-sol v i ng approach , cl ear 

expectations stated, efficiently introduced <4 = 22/i> 

— feelings and attitudes: unique, fascinating, insights, 

dignity, opportunity to Influence others <3 = 17X> 

— confidence in teaching malnstreamed students: <2 = IVA> 

— focus on individual needs and interests: <1 = 6%) 

— Instructor: enthusiastic, knowledgeable <1 = 6/^> 

Why not? 

— computer not helpful (1 = 67.) 

Question 2: Make on& statement about the course. 

— attitudes and feelings: excitement, renewal, relaxation, 
enjoyment. Interesting, confidence, useful <7 == 39*A) 

— le€:rnc^d alot: <5 = 23/.) 

— new e.pprec i at i on for mai nstreemi ng: <3 = 17%) 
— effective presentation: <3 = 17%) 
—tropts: (1 ^ 6X> 
— mcr^e time: <1 ^ <5a> 

— observations of little values <1 = 6X> 

— teft blank: <i = 6X) 

Question 3: What changes would you like to see? 

— more: films, discussion, videos, presentations, copies of 
tropts, accessibility of tropis, use of blue book, 
non-recommended tropts <8 = 44!^^) 
— more time: (6 = 33/.) 

— Less: writing, fewer tropts, discussion <4 = 227.) 
— function of computer?: (4 = 22%) 

— change classroom sel f-observat i nn : too time-consuming, 
1 i ttle help (3 = 17%) 

— add a general text on mai nstreami ng: (1 = 6%) 
— combine "David" and George Will into one tropt: <1 = 6%) 
— satisfy special ed recer t i f i cat i on requirement: (1 = 67) 
— noth i ng: < 1 = 67) 
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Question 4s What are the strengths of the course? 



— tropts: variety, quality, accessibility, targetted 
Information, applicable across grades and subjects, 
up-tc-date (11 « 61/.) 

— sharing with participants: (11 = 617.) 

— i ns true tor : personal ity, energy, knowl edg© , v i tal i ty , 
flexibility, support, facilitation skill (8 = 44%) 

— focus on individual needs and design of own learning: 
(6 = 33X> 

--atmosphere: open, relaxed, low-pressure, casual , low 
memorization, supportive <4 == 22%) 
— presentations: (1 = 6X> 

SUMMARY 

The course was perceived by the participants as highly 
successful. Positive comments outnumbered negative comments 
by 5 to 1 . The negative comments that were made suggested 
Improvements rather than expressing di ssat i f ac t i on with the 
course. Participants believed they had learned much that 
would positively influence their teaching. 

Strengths of the course as metnio.ned by the 
participants, from high to low frequency include: 
— the training options were perceived as the strongest 
aspect of the course; 

— the sharing that occurred between participants was highly 
val ued; 

— the positive feelings and attitudes generated by the 
course were deemed important; 

— the effectiveness and enthusiasm of the instructor 
contributed significantly to the feelings, attitudes, and 
learnings of the participants; 

— the structure and environment of the course (addressing 
individual needs, time for sharing and discussion, clear 
expectations, involvement in designing own learning, 
supportive atmosphere) also contributed to the participants 
learning and enthusiasm for the course; 

— the course increased the par t i c i pan t'' s awareness of the 
needs of mainstreamed students and their own abilities to 
integrate and teach those students effectively. 

In sum, the tropts, the structure and atmosphere of the 
course, and the effectiveness and enthusiam of the 
instructor all contributed to a most successful learning 
experience for the part i c i pan ts. 

The weaknesses of the course as mentioned by the 
participants, from high to low frequency include: 
— the limited accessibility of the tropts made it difficult 
to locate those that were needed; some participants wanted 
more use of the blue book for selecting their own tropts and 
more time for non-recommended tropts; others wanted fewer 
tropts to be studied and used in greater depth; 
— the majority of participants requested more time; 
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— the role and importance of the computer and of the 
classroom observations were questioned by about one-quarter 
of the par t i c i pants. 

In sum, difficulty in obtaining and choosing tropts was 
troublesome. The situation might be eased by providing 
multiple copies of tropts and providing additional time for 
pursuing interests in non-recommended tropts, realizing that 
this will not lend itself to in depth treatment of a given 
tr op t . 

Time was limited; perhaps the course could be extended 
over a greater period of time (i.e., a semester) with more 
time to read and try out tropts, more time for presentations 
by participants, and more time for depth of study. 

The process that preceded the course itself — involving 
the computer and the classroom observations — was unclear to 
the par ticip ants. The importance of the cl assroom 
observiit i ons and the role of the computer need to be 
clarified for the participants. 



ERIC 



4-^5 



